-- Logs begin at Thu 2021-11-11 16:12:42 UTC, end at Thu 2021-11-11 17:34:26 UTC. -- Nov 11 16:54:33.829151 dv-cinder-694140-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 11 16:54:33.839363 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 11 16:54:33 2021] *** Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: nodename: dv-cinder-694140-2-iscsi Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: machine: x86_64 Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: clock source: unix Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: pcre jit disabled Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: detected number of CPU cores: 4 Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: current working directory: / Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: detected binary path: /usr/bin/uwsgi-core Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: your processes number limit is 47680 Nov 11 16:54:33.841390 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: your memory page size is 4096 bytes Nov 11 16:54:33.842197 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: detected max file descriptor number: 2048 Nov 11 16:54:33.842197 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: lock engine: pthread robust mutexes Nov 11 16:54:33.842197 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: thunder lock: enabled Nov 11 16:54:33.842197 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 11 16:54:33.842197 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 11 16:54:33.886952 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: Python main interpreter initialized at 0x56164e5449c0 Nov 11 16:54:33.886952 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: python threads support enabled Nov 11 16:54:33.886952 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: your server socket listen backlog is limited to 100 connections Nov 11 16:54:33.886952 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: your mercy for graceful operations on workers is 90 seconds Nov 11 16:54:33.887316 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: mapped 403077 bytes (393 KB) for 2 cores Nov 11 16:54:33.887396 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: *** Operational MODE: preforking *** Nov 11 16:54:33.887674 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: *** uWSGI is running in multiple interpreter mode *** Nov 11 16:54:33.887674 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: spawned uWSGI master process (pid: 79370) Nov 11 16:54:33.887879 dv-cinder-694140-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 11 16:54:33.888443 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: spawned uWSGI worker 1 (pid: 79380, cores: 1) Nov 11 16:54:33.888779 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: spawned uWSGI worker 2 (pid: 79381, cores: 1) Nov 11 16:54:33.889647 dv-cinder-694140-2-iscsi devstack@keystone.service[79370]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 11 16:54:39.059298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 16:54:39.059298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: from cryptography.utils import int_from_bytes Nov 11 16:54:39.060356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 16:54:39.060356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: from cryptography.utils import int_from_bytes Nov 11 16:54:39.060497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 16:54:39.060497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: from cryptography.utils import int_from_bytes Nov 11 16:54:39.060497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 16:54:39.060497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: from cryptography.utils import int_from_bytes Nov 11 16:54:39.108803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 16:54:39.109018 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 16:54:39.109116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 16:54:39.109197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 16:54:39.109260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] command line args: [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 16:54:39.109330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] command line args: [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 16:54:39.109509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 16:54:39.109598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 16:54:39.109659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ================================================================================ {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 16:54:39.109965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ================================================================================ {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 16:54:39.110100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] admin_token = **** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.110264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] admin_token = **** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.110340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] config_dir = [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.110444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] config_dir = [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.110517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.110696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.110777 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] config_source = [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.110849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] config_source = [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.111043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] debug = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.111111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] debug = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.111175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.112542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.112542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.112874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.113013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.113172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.113306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.113443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.113580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.113709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.113842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] list_limit = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.113970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] list_limit = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.114095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] log_config_append = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.114233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] log_config_append = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.114358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.114479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.114479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] log_dir = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.114732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] log_dir = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.114820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] log_file = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.114949 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] log_file = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.115885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.116964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117548 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.117981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] publish_errors = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] publish_errors = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118883 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.118957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] standard_threads = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] standard_threads = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] use_journal = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] use_journal = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] use_json = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.119937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] use_json = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.120014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] use_stderr = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.120093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] use_stderr = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.120224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] use_syslog = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.120307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] use_syslog = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.120417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.120501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 16:54:39.120573 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.120649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.120720 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.120789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.120911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.120993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.121976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.122962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.123060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.123211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.123298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.123459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.123542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.123697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.123784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.124460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.124552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.124714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.124809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.124962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.125038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.125186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.125266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.125447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.125526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.125699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.125784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.125948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.126983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.127145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.127229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.127389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.127473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.127621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.127698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.127849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.127927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.128096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.128174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.128341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.128423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.128577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.128655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.128823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.128913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.129979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.130067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.130206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.130289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.130435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.130517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.130696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.130794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.130944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.131947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.132102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.132187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.132346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.132425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.132575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.132654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.132807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.132894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133352 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.133969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.134047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.134214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.134301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.134448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.134528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.134707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.134827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.134953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.135088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.135206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.135341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.135470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.135607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.135724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.135846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.135963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.136077 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.136191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.136304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.136424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.136552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.136670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.136784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.136898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.137987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.138110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.138226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.138340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.138454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.138628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.138760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.138876 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.138990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.139111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.139227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.139342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.139464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.139718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.140329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.140444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.140558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.140679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.140803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.140920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141034 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.141968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.142083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.142206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.142322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.142436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.142563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.142679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.142794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.142920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.143044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.143159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.143273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] auth.external = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.143398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] auth.external = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.143520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.143643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.143771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.143889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.144015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.144143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.144282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] auth.password = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.144403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] auth.password = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.144524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] auth.token = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.144641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] auth.token = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.144759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.144874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.145067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.145193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.145315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.145440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.145554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.145668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.145790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.145907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.146021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.146136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.146250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.146363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.146485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] credential.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.146666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] credential.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.146797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.146797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.147945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.148059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.148183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.148300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.148415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.148530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.148645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.148760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.148886 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.149003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.149130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.149251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.149384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.149554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.149686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.149787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.149902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] federation.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150496 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] federation.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.150985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.151109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.151226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.151347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.151470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.151589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.151705 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.151828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.151945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.152060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.152175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.152290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.152405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.152529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.152652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.152768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.152884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153478 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.153946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.154950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.155050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.155148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.155354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.155500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.155603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.155700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.155797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.155901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.156904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157219 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.157918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.158022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.158118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.158215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.158324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.158429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.159096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.159217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.159333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.159461 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.159579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.159696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.159811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.159926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.160049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.160252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.160367 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.160481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.160595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.160710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.160831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.161019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.161174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.161339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.161459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.161574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.161688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.161812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.161928 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.162043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.162156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.162270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.162383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.162504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.162684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.162799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.162914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163510 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.163975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.164143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.164270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.164399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.164516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.164647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.164818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.164950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.165070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.165186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.165312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.165446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.165574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.165694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.165828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.165954 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.166085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.166214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.166341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.166477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.166620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.166748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.166876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.166995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.167131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.167251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.167376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.167493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.167621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.167740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.167864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.167987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.168106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.168221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.168336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.168451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.168573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.168696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.168812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.168927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.169865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.170084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.170200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.170315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.170429 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.170580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.170699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.170814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.170929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171403 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.171984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.172101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.172216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.172332 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.172459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.172577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.172704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.172831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.172947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.173072 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.173190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.173314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.173467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.173585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.173701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.173815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.173931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.174046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.174169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.174286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.174403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.174518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] resource.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.174655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.174771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.174899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] resource.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175843 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.175964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.176079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.176193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.176317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.176433 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.176550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.176665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.176781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.176903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] role.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] role.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] role.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] role.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.177993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.178110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.178236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.178355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.178527 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.178710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.178829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.178946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.179062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.179178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.179306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.179424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.179547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.179666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.179781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.179897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.180948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.181063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.181179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.181179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.181410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.181526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.181642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.181758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.181885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.182013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.182130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.182258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.182374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.182502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.182639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.182766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.182885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183116 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.183932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184048 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184720 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.184980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.185220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.185335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] token.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.185479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.185655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.185794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.185794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.186014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.186130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] token.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.186244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.186359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.186999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.187920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.188138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.188138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.188361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.188478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.188605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.188734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.188862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.188999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.189120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.189255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.189377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.189492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.189607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.189748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.189869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.190005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.190139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.190139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.190383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.connection = **** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.190511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.190706 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.190706 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.190938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.191065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.191196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.connection = **** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.191337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.191470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.191634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.191782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.191912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.192038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.192204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.192338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.192466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.192584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.192711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.192828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.192951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.193069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.193185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.193323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.193449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.193570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.193696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.193811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.193947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.194066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.194202 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.194331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.194494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.194649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.194826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.194957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.195075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.195190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.195305 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 16:54:39.195423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.195423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.195423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 16:54:39.195423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 16:54:39.224022 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.224256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.224344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.224489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.224613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.224775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.233154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.234031 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.262719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.262944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.263262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.263481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.318016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.318191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.457351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.457582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.457728 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.457966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.524235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.524482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.524584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.524674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.524798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.524916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.525007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.525084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.525223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.525308 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.525443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.525660 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.551433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.551623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.551783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.551869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.551997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.552865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.564716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.564865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.577555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.577787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.577877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79381) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.578995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.579096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 11 16:54:39.596497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.596704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 11 16:54:39.597050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.597173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.597259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 11 16:54:39.597386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 11 16:54:39.597509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.597721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.597806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.597919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 11 16:54:39.598000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.598183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.598263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.598443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.598714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.598967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.609671 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.610210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.610478 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.610601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.610788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.610885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.611049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.611325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.618796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.619301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.622255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.622498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.622603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.622800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.622894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.623079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.623170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.623361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.623451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.623621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.623702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.623890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.623970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.624188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.624277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.624461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.624564 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.624836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.624916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.625106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.625206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.625369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.651050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.651193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.652635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.652747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.652915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.653024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.658846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.659126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.659404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.666573 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.666681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.666860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.666970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.667141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.671863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.672159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.672437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.672725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.673108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.673389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.673658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.673929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.675457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.675709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.680052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.680352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.680640 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.680950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.681403 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.681741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.682008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.682274 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.692724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.693004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.697665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.701293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.701387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.701558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.701661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.706482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.706652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.710089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.710181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.710419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.713837 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.714141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.714430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.714861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.715153 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.715437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.715635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.720000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.723788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.724100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.724404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.724837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.725140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.725417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.735445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.735807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.736003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.736277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.744214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.745310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.745601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.745864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.745950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.746122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.746227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.749267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.749557 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.749837 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.750125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.750405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.754226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.756046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.756317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.759306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.759589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.759865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.760145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.760418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.763631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.763917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.764201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.764479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.764795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.765072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.765360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.773740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.774016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.774289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.774601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.774880 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.775155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.775432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.783484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.788170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.791555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.793138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.794764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.795044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.795332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.795417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.800931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.803227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.804302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.804811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.805850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.807645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.807917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.808004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.808217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.808304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.808530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.808811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.815897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.817632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.817796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.818086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.818366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.821585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.821870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.822150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.822423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.826231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79381) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.826510 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.826811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.827084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.827404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.827703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.827939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.828214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.828490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.828759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.829050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.829313 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.829576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.829835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79381) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.831578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.831888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.832184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.840509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 11 16:54:39.840782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.841052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.841322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.841600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.841863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.842130 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.842390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.842696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.843489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.843787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.844063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.844421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.844678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 11 16:54:39.868560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56164e5449c0 pid: 79381 (default app) Nov 11 16:54:39.871959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f256c0-1884-4e62-bb5c-12dc24aaf2d8 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:39.872251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f256c0-1884-4e62-bb5c-12dc24aaf2d8 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:39.872528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f256c0-1884-4e62-bb5c-12dc24aaf2d8 None None] PATH_INFO: `/v3` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:39.876849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Nov 11 16:54:39 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:54:39.887525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56164e5449c0 pid: 79380 (default app) Nov 11 16:54:48.857995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928cf1d-74b2-4839-96e1-eaff01ab5ed4 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:48.858519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928cf1d-74b2-4839-96e1-eaff01ab5ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:48.858519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928cf1d-74b2-4839-96e1-eaff01ab5ed4 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:48.861505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:54:48.870976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:48.871474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:48.871563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:48.900850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG oslo_db.sqlalchemy.engines [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 16:54:49.096725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG passlib.handlers.bcrypt [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79380) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 11 16:54:49.097134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG passlib.handlers.bcrypt [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79380) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 11 16:54:49.152003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:49.153536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:49.285137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:54:49.411112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928cf1d-74b2-4839-96e1-eaff01ab5ed4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:49.443844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG oslo_db.sqlalchemy.engines [None req-5928cf1d-74b2-4839-96e1-eaff01ab5ed4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 16:54:49.573919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928cf1d-74b2-4839-96e1-eaff01ab5ed4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:49.578069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e5592-603b-4f0f-bef0-35f641d1e3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:49.579305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e5592-603b-4f0f-bef0-35f641d1e3fa admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:49.579583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e5592-603b-4f0f-bef0-35f641d1e3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:49.579853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e5592-603b-4f0f-bef0-35f641d1e3fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:49.587895 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e5592-603b-4f0f-bef0-35f641d1e3fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:49.637341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.common.rbac_enforcer.enforcer [None req-381e5592-603b-4f0f-bef0-35f641d1e3fa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 11 16:54:49.637670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e5592-603b-4f0f-bef0-35f641d1e3fa admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:49.647440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:54:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:54:49.654219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:49.668722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926f689-0c03-4a58-a44d-da349fdc21e1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:49.673709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bef48d-476a-46c0-9a7e-cb9c01b67e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:49.674816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef48d-476a-46c0-9a7e-cb9c01b67e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:49.675101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef48d-476a-46c0-9a7e-cb9c01b67e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:49.675384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bef48d-476a-46c0-9a7e-cb9c01b67e58 admin admin] PATH_INFO: `/v3/projects/a62f9c4d0b7f4443a8eb78e076640010` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:49.676998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bef48d-476a-46c0-9a7e-cb9c01b67e58 admin admin] RBAC: Authorizing `identity:get_project(project_id=a62f9c4d0b7f4443a8eb78e076640010)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:49.728278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72bef48d-476a-46c0-9a7e-cb9c01b67e58 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 11 16:54:49.728616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bef48d-476a-46c0-9a7e-cb9c01b67e58 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:49.733130 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 2/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:54:49 2021] GET /identity/v3/projects/a62f9c4d0b7f4443a8eb78e076640010 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:54:51.978209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0620-48a9-4afe-b851-0e32ca92f640 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:51.978816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0620-48a9-4afe-b851-0e32ca92f640 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:51.978816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d0620-48a9-4afe-b851-0e32ca92f640 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:51.983212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 4/6] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:54:51.990235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870004bb-773c-41cf-aeef-00ddf8d3ff68 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:51.990653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870004bb-773c-41cf-aeef-00ddf8d3ff68 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:51.990817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870004bb-773c-41cf-aeef-00ddf8d3ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:52.008979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-870004bb-773c-41cf-aeef-00ddf8d3ff68 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:52.010488 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-870004bb-773c-41cf-aeef-00ddf8d3ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:52.018767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:54:52.042500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d0620-48a9-4afe-b851-0e32ca92f640 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:52.054465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d0620-48a9-4afe-b851-0e32ca92f640 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:52.058623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa72341-bfb1-4610-96ac-37ee102f8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:52.059251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72341-bfb1-4610-96ac-37ee102f8ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:52.059533 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72341-bfb1-4610-96ac-37ee102f8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:52.059806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72341-bfb1-4610-96ac-37ee102f8ec1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:52.067381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa72341-bfb1-4610-96ac-37ee102f8ec1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:52.069152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa72341-bfb1-4610-96ac-37ee102f8ec1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:52.077535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:54:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:54:52.085410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870004bb-773c-41cf-aeef-00ddf8d3ff68 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:52.094907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870004bb-773c-41cf-aeef-00ddf8d3ff68 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:52.099225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2c5e7-c253-4c6c-becf-a7c385351bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:52.100070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c5e7-c253-4c6c-becf-a7c385351bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:52.100345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c5e7-c253-4c6c-becf-a7c385351bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:52.100613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c5e7-c253-4c6c-becf-a7c385351bd4 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:52.102054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2c5e7-c253-4c6c-becf-a7c385351bd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:52.103898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2c5e7-c253-4c6c-becf-a7c385351bd4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:52.105409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 4/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:54:52 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:54:54.455076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24e90-4c1f-4399-a5d6-afe43b53c1da None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.455647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24e90-4c1f-4399-a5d6-afe43b53c1da None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.455647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24e90-4c1f-4399-a5d6-afe43b53c1da None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.457270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:54:54.463312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd6a2-6a4f-4167-a22b-96ff0435cd64 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.463756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29f884-30fd-44e6-8247-f9c96e01320f None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.463847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd6a2-6a4f-4167-a22b-96ff0435cd64 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.463928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29f884-30fd-44e6-8247-f9c96e01320f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.464005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfd6a2-6a4f-4167-a22b-96ff0435cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.464100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29f884-30fd-44e6-8247-f9c96e01320f None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.465650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 7/11] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:54:54.472495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.472773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.473044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.482742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-d9bfd6a2-6a4f-4167-a22b-96ff0435cd64 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:54.483946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d9bfd6a2-6a4f-4167-a22b-96ff0435cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:54.491798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:54:54.516796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG passlib.handlers.bcrypt [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79381) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 11 16:54:54.517223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG passlib.handlers.bcrypt [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79381) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 11 16:54:54.517359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfd6a2-6a4f-4167-a22b-96ff0435cd64 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:54.526432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfd6a2-6a4f-4167-a22b-96ff0435cd64 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:54.531624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b0029-925c-41a1-9bcd-4a3f4db062d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:54.533134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b0029-925c-41a1-9bcd-4a3f4db062d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.533422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b0029-925c-41a1-9bcd-4a3f4db062d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.533700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b0029-925c-41a1-9bcd-4a3f4db062d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.546686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b0029-925c-41a1-9bcd-4a3f4db062d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:54:54.553749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-e76b0029-925c-41a1-9bcd-4a3f4db062d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:54:54.554977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 6/13] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:54:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:54:54.562384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b0029-925c-41a1-9bcd-4a3f4db062d0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:54.563456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:54.565066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:54.572317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b0029-925c-41a1-9bcd-4a3f4db062d0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:54.576764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:54.577408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.577692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.577966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.579274 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:54:54.579579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:54.581312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:54:54.581312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:54:54.581312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:54:54.582219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:54.591977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 8/14] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:54:54.596171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 7/15] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:54:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:54:54.602295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:54.612024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e18f2-6067-4039-8150-1bb8c5f1e019 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:54.614936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:54.618383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e2048-2980-45ed-96d8-9aebe0af1a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:54.619614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e2048-2980-45ed-96d8-9aebe0af1a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.619897 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e2048-2980-45ed-96d8-9aebe0af1a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.620171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e2048-2980-45ed-96d8-9aebe0af1a2a admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.621743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e2048-2980-45ed-96d8-9aebe0af1a2a admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:54.623669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e2048-2980-45ed-96d8-9aebe0af1a2a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:54.625272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:54:54 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:54:54.630318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1295390-cc71-46c1-9581-d6747cb583d8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:54.634958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3df86-ccc0-440f-bd6d-8ea2f798d217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:54.635588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e2048-2980-45ed-96d8-9aebe0af1a2a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:54.635707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3df86-ccc0-440f-bd6d-8ea2f798d217 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.635963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3df86-ccc0-440f-bd6d-8ea2f798d217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.636149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3df86-ccc0-440f-bd6d-8ea2f798d217 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.644865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3df86-ccc0-440f-bd6d-8ea2f798d217 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:54.645841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e2048-2980-45ed-96d8-9aebe0af1a2a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:54.646687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3df86-ccc0-440f-bd6d-8ea2f798d217 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:54.650466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8d74-927c-4420-ab07-fdb818a7419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:54.651255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8d74-927c-4420-ab07-fdb818a7419c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.651532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8d74-927c-4420-ab07-fdb818a7419c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.651804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8d74-927c-4420-ab07-fdb818a7419c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.653061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe8d74-927c-4420-ab07-fdb818a7419c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:54.654804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe8d74-927c-4420-ab07-fdb818a7419c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:54.655831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:54:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:54:54.656348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:54:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:54:54.662888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3df86-ccc0-440f-bd6d-8ea2f798d217 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:54.663271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8d74-927c-4420-ab07-fdb818a7419c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:54.672217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3df86-ccc0-440f-bd6d-8ea2f798d217 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:54.672775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8d74-927c-4420-ab07-fdb818a7419c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:54.676769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b39ead-6824-48ce-8813-c668edb99ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:54.677194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af26a67-d037-4959-968a-ebdc8cc5a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:54.677414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b39ead-6824-48ce-8813-c668edb99ade admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.677700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b39ead-6824-48ce-8813-c668edb99ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.677960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26a67-d037-4959-968a-ebdc8cc5a9af admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:54.678086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b39ead-6824-48ce-8813-c668edb99ade admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.678240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26a67-d037-4959-968a-ebdc8cc5a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:54.678514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26a67-d037-4959-968a-ebdc8cc5a9af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:54.678828 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b39ead-6824-48ce-8813-c668edb99ade admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.domain.id=default, user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:54:54.679142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b39ead-6824-48ce-8813-c668edb99ade admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:54.679732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af26a67-d037-4959-968a-ebdc8cc5a9af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:54.680139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-43b39ead-6824-48ce-8813-c668edb99ade admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:54:54.680139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:54:54.680139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:54:54.681309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b39ead-6824-48ce-8813-c668edb99ade admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:54.681446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af26a67-d037-4959-968a-ebdc8cc5a9af admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:54.683039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 11/19] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:54:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:54:54.689493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 9/20] 10.222.0.16 () {56 vars in 1343 bytes} [Thu Nov 11 16:54:54 2021] GET /identity/v3/role_assignments?user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0&scope.domain.id=default&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:54:57.395118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceec55-d9e1-46d3-be39-4ad545841227 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.396148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceec55-d9e1-46d3-be39-4ad545841227 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.396645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceec55-d9e1-46d3-be39-4ad545841227 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.398993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 12/21] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:54:57.405272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3671-c294-426d-ac5b-46f219255a10 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.406321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3671-c294-426d-ac5b-46f219255a10 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.406846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3671-c294-426d-ac5b-46f219255a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.434833 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4c9d3671-c294-426d-ac5b-46f219255a10 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:57.436388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4c9d3671-c294-426d-ac5b-46f219255a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:57.445603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 10/22] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:54:57.455090 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ddbc-f2df-47de-86c4-f95fd9954d0a None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.455369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ddbc-f2df-47de-86c4-f95fd9954d0a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.455806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ddbc-f2df-47de-86c4-f95fd9954d0a None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.458047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 13/23] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:54:57.464196 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aef4d-a658-4108-857f-6511790ffeb2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.464557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aef4d-a658-4108-857f-6511790ffeb2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.464929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aef4d-a658-4108-857f-6511790ffeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.468769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ddbc-f2df-47de-86c4-f95fd9954d0a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.487519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ddbc-f2df-47de-86c4-f95fd9954d0a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:57.489785 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-194aef4d-a658-4108-857f-6511790ffeb2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:57.492574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-194aef4d-a658-4108-857f-6511790ffeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:57.496131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:57.498030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.498521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.499358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.501399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:57.504787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:54:57.504787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:54:57.504787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:54:57.506770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:57.513966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:54:57.538615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aef4d-a658-4108-857f-6511790ffeb2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.548644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aef4d-a658-4108-857f-6511790ffeb2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:57.558535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbde2-e6c4-4a7f-9013-a671c363d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:57.559415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbde2-e6c4-4a7f-9013-a671c363d166 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.559694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbde2-e6c4-4a7f-9013-a671c363d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.559966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdbde2-e6c4-4a7f-9013-a671c363d166 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.574643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdbde2-e6c4-4a7f-9013-a671c363d166 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:54:57.581970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-94cdbde2-e6c4-4a7f-9013-a671c363d166 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:54:57.583259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 12/25] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:54:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:54:57.590114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbde2-e6c4-4a7f-9013-a671c363d166 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.605171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdbde2-e6c4-4a7f-9013-a671c363d166 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:57.613943 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5426f1c-1b1e-4909-8e0b-cced9aed9cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:57.614690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426f1c-1b1e-4909-8e0b-cced9aed9cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.615028 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426f1c-1b1e-4909-8e0b-cced9aed9cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.615314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426f1c-1b1e-4909-8e0b-cced9aed9cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.616092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5426f1c-1b1e-4909-8e0b-cced9aed9cd8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:54:57.616399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5426f1c-1b1e-4909-8e0b-cced9aed9cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:57.618108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5426f1c-1b1e-4909-8e0b-cced9aed9cd8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:57.629290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 13/26] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:54:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:54:57.630906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da5fa-de65-4f5e-9252-226085e95719 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.631859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da5fa-de65-4f5e-9252-226085e95719 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.631859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da5fa-de65-4f5e-9252-226085e95719 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.634159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:54:57.641643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406610-9eae-43b6-b00d-1601e4cfa91a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.641922 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406610-9eae-43b6-b00d-1601e4cfa91a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.642205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406610-9eae-43b6-b00d-1601e4cfa91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.671740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-44406610-9eae-43b6-b00d-1601e4cfa91a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:57.673616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-44406610-9eae-43b6-b00d-1601e4cfa91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:57.685606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:54:57.686375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406610-9eae-43b6-b00d-1601e4cfa91a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.698381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406610-9eae-43b6-b00d-1601e4cfa91a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:57.717543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b98bd8-7c32-47cc-8eef-f9f1afe90ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:57.717543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b98bd8-7c32-47cc-8eef-f9f1afe90ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.717543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b98bd8-7c32-47cc-8eef-f9f1afe90ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.717543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b98bd8-7c32-47cc-8eef-f9f1afe90ffe admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.719261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b98bd8-7c32-47cc-8eef-f9f1afe90ffe admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:57.721867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b98bd8-7c32-47cc-8eef-f9f1afe90ffe admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:57.724062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 16/29] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:54:57 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:54:57.730380 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b98bd8-7c32-47cc-8eef-f9f1afe90ffe admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.756899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b98bd8-7c32-47cc-8eef-f9f1afe90ffe admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:57.763337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c647a10-070f-4dd6-849b-0ae96376dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:57.763703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 14/30] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 16:54:57 2021] POST /identity/v3/roles => generated 219 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:54:57.764154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647a10-070f-4dd6-849b-0ae96376dfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.764436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647a10-070f-4dd6-849b-0ae96376dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.764710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647a10-070f-4dd6-849b-0ae96376dfd8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.765009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.767412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c647a10-070f-4dd6-849b-0ae96376dfd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:57.769180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c647a10-070f-4dd6-849b-0ae96376dfd8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:57.770929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 17/31] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:54:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:54:57.778253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c647a10-070f-4dd6-849b-0ae96376dfd8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.793113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe017-91a7-4fbd-8c9c-5830d00223c5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:57.800243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:57.801059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.801345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.801516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c647a10-070f-4dd6-849b-0ae96376dfd8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:57.801689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.812994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbd463-59ab-428f-9c9d-49ea7c16f572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:57.813945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd463-59ab-428f-9c9d-49ea7c16f572 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.814280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd463-59ab-428f-9c9d-49ea7c16f572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.814502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd463-59ab-428f-9c9d-49ea7c16f572 admin admin] PATH_INFO: `/v3/domains/default/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.820193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbd463-59ab-428f-9c9d-49ea7c16f572 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:57.822145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-18cbd463-59ab-428f-9c9d-49ea7c16f572 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:54:57.822145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:54:57.822145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:54:57.824295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbd463-59ab-428f-9c9d-49ea7c16f572 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:57.838705 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:57.840946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:57.864321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:54:57.865948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 15/32] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:54:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:54:57.874591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.888032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e97a6f-2de9-4466-885d-a86ac51c9dd3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:57.896240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:57.896956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:57.897235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:57.900931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:57.900931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:54:57.900931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:57.900931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:54:57.900931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:54:57.900931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:54:57.900931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:57.932948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:54:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:54:57.939839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:57.980241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca97d0-1401-4dcf-8fbe-e8df2c770eac admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:58.158582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60892c-d546-4c2a-a0de-423844317619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:58.159284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60892c-d546-4c2a-a0de-423844317619 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:58.159564 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60892c-d546-4c2a-a0de-423844317619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:58.160511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60892c-d546-4c2a-a0de-423844317619 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:58.160689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60892c-d546-4c2a-a0de-423844317619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:58.161855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-2b60892c-d546-4c2a-a0de-423844317619 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:54:58.161855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:54:58.161855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:54:58.163771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60892c-d546-4c2a-a0de-423844317619 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:58.173638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 18/34] 10.222.0.16 () {58 vars in 1382 bytes} [Thu Nov 11 16:54:57 2021] PUT /identity/v3/domains/default/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:54:58.294039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 17/35] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:54:57 2021] POST /identity/v3/projects => generated 301 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:54:58.503689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ecede-b176-421e-85b6-6ca8d6d30573 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:58.504394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ecede-b176-421e-85b6-6ca8d6d30573 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:58.504394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ecede-b176-421e-85b6-6ca8d6d30573 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:58.509330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:58 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:54:58.515917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bacc-b133-4eac-8a2b-cc92050b8e61 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:58.516496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bacc-b133-4eac-8a2b-cc92050b8e61 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:58.516496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bacc-b133-4eac-8a2b-cc92050b8e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:58.539883 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-25a6bacc-b133-4eac-8a2b-cc92050b8e61 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:58.541431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-25a6bacc-b133-4eac-8a2b-cc92050b8e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:58.617083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 18/37] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:54:58.659183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ecede-b176-421e-85b6-6ca8d6d30573 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:58.677301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ecede-b176-421e-85b6-6ca8d6d30573 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:58.681747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e59dd-ee88-4f44-8282-9c887e6f469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:58.682414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e59dd-ee88-4f44-8282-9c887e6f469a admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:58.682733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e59dd-ee88-4f44-8282-9c887e6f469a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:58.683015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e59dd-ee88-4f44-8282-9c887e6f469a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:58.683784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e59dd-ee88-4f44-8282-9c887e6f469a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:58.684981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-647e59dd-ee88-4f44-8282-9c887e6f469a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:54:58.684981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:54:58.684981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:54:58.685905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e59dd-ee88-4f44-8282-9c887e6f469a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:58.789564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 16:54:58 2021] POST /identity/v3/roles => generated 225 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:54:59.129022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4fce4-d2c7-42e2-9bc0-58e017777bf0 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:59.129416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4fce4-d2c7-42e2-9bc0-58e017777bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:59.129599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4fce4-d2c7-42e2-9bc0-58e017777bf0 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:59.131433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 19/39] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:54:59.137402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244e48-e988-4398-8c3d-0d90a3f4360d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:59.137699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244e48-e988-4398-8c3d-0d90a3f4360d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:59.137982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244e48-e988-4398-8c3d-0d90a3f4360d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:59.145268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad527-bbae-4865-940d-70a134b78dbf None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:59.145560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad527-bbae-4865-940d-70a134b78dbf None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:59.146617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ad527-bbae-4865-940d-70a134b78dbf None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:59.147825 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 20/40] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:54:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:54:59.155941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf28c6-6ab3-40c2-bc46-90110537668e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:59.155941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf28c6-6ab3-40c2-bc46-90110537668e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:59.155941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf28c6-6ab3-40c2-bc46-90110537668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:59.158170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b7244e48-e988-4398-8c3d-0d90a3f4360d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:59.159451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b7244e48-e988-4398-8c3d-0d90a3f4360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:59.167371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:54:59.172347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6caf28c6-6ab3-40c2-bc46-90110537668e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:54:59.173538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6caf28c6-6ab3-40c2-bc46-90110537668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:54:59.183185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:54:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:54:59.192603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7244e48-e988-4398-8c3d-0d90a3f4360d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:59.201586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7244e48-e988-4398-8c3d-0d90a3f4360d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:59.207010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ed70f-9cbd-4cd1-9faf-3fa40853f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:59.207395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf28c6-6ab3-40c2-bc46-90110537668e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:59.207807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ed70f-9cbd-4cd1-9faf-3fa40853f151 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:59.208087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ed70f-9cbd-4cd1-9faf-3fa40853f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:59.208360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ed70f-9cbd-4cd1-9faf-3fa40853f151 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:59.209689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ed70f-9cbd-4cd1-9faf-3fa40853f151 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:59.212389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ed70f-9cbd-4cd1-9faf-3fa40853f151 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:59.213082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:54:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:54:59.217297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf28c6-6ab3-40c2-bc46-90110537668e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:59.218772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ed70f-9cbd-4cd1-9faf-3fa40853f151 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:54:59.221824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581a595-d021-4f1c-ba65-5ddc12661f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:59.222494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581a595-d021-4f1c-ba65-5ddc12661f88 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:59.222817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581a595-d021-4f1c-ba65-5ddc12661f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:59.223101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581a595-d021-4f1c-ba65-5ddc12661f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:59.223863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581a595-d021-4f1c-ba65-5ddc12661f88 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:59.225558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581a595-d021-4f1c-ba65-5ddc12661f88 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:59.228050 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ed70f-9cbd-4cd1-9faf-3fa40853f151 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:54:59.232741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff169d-3f40-4792-8443-159e06fbf48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:54:59.233468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff169d-3f40-4792-8443-159e06fbf48d admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:54:59.233817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff169d-3f40-4792-8443-159e06fbf48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:54:59.234157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff169d-3f40-4792-8443-159e06fbf48d admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:54:59.234979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff169d-3f40-4792-8443-159e06fbf48d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:54:59.236158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-2fff169d-3f40-4792-8443-159e06fbf48d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:54:59.236158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:54:59.236158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:54:59.237617 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff169d-3f40-4792-8443-159e06fbf48d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:54:59.330004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 16:54:59 2021] POST /identity/v3/roles => generated 223 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:54:59.346690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:54:59 2021] POST /identity/v3/projects => generated 312 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:00.671481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450ce1-0b9f-437e-bc7d-9b18b6e3c795 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:00.672026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450ce1-0b9f-437e-bc7d-9b18b6e3c795 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:00.672026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30450ce1-0b9f-437e-bc7d-9b18b6e3c795 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:00.673824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 23/46] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:00.679749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b7d2-1778-405f-9246-dc000a3ddb2d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:00.680205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b7d2-1778-405f-9246-dc000a3ddb2d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:00.680306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b7d2-1778-405f-9246-dc000a3ddb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:00.698047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c029b7d2-1778-405f-9246-dc000a3ddb2d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:00.699260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c029b7d2-1778-405f-9246-dc000a3ddb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:00.756625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 24/47] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:00.782321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30450ce1-0b9f-437e-bc7d-9b18b6e3c795 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:00.795017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30450ce1-0b9f-437e-bc7d-9b18b6e3c795 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:00.799349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd27d2-dc1c-4700-b978-301e49b45b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:00.800179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd27d2-dc1c-4700-b978-301e49b45b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:00.800459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd27d2-dc1c-4700-b978-301e49b45b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:00.800734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd27d2-dc1c-4700-b978-301e49b45b14 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:00.812999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd27d2-dc1c-4700-b978-301e49b45b14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:00.820469 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-2cbd27d2-dc1c-4700-b978-301e49b45b14 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:00.821636 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:00.828273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029b7d2-1778-405f-9246-dc000a3ddb2d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:00.837845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029b7d2-1778-405f-9246-dc000a3ddb2d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:00.842643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:00.843304 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:00.843635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:00.843867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:00.844633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:00.844941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:00.846635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:00.855044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:00.861634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd27d2-dc1c-4700-b978-301e49b45b14 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:00.877146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd27d2-dc1c-4700-b978-301e49b45b14 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:00.881545 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324753-d3fd-4b5c-9132-94b6196f2ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:00.882404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324753-d3fd-4b5c-9132-94b6196f2ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:00.882723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324753-d3fd-4b5c-9132-94b6196f2ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:00.882998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324753-d3fd-4b5c-9132-94b6196f2ae4 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:00.884214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9324753-d3fd-4b5c-9132-94b6196f2ae4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:00.886042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9324753-d3fd-4b5c-9132-94b6196f2ae4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:00.887668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:00 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:00.894530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:00.904974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed722-3b3c-446f-8ee3-1ece370f1083 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:00.909625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cb112-1f56-4b05-89fc-65aef97aaf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:00.910428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cb112-1f56-4b05-89fc-65aef97aaf32 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:00.910741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cb112-1f56-4b05-89fc-65aef97aaf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:00.911235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cb112-1f56-4b05-89fc-65aef97aaf32 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:00.912238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cb112-1f56-4b05-89fc-65aef97aaf32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:00.914009 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cb112-1f56-4b05-89fc-65aef97aaf32 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:00.915644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:00.922142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324753-d3fd-4b5c-9132-94b6196f2ae4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:00.931762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324753-d3fd-4b5c-9132-94b6196f2ae4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:00.936081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ea7a8-8bdd-4ea0-b240-5512a656e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:00.936725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea7a8-8bdd-4ea0-b240-5512a656e83c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:00.937009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea7a8-8bdd-4ea0-b240-5512a656e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:00.937288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea7a8-8bdd-4ea0-b240-5512a656e83c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:00.938117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ea7a8-8bdd-4ea0-b240-5512a656e83c admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.domain.id=default, user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:00.938427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ea7a8-8bdd-4ea0-b240-5512a656e83c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:00.939963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-f50ea7a8-8bdd-4ea0-b240-5512a656e83c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:00.939963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:55:00.939963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:55:00.941136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ea7a8-8bdd-4ea0-b240-5512a656e83c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:00.948205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 26/52] 10.222.0.16 () {56 vars in 1343 bytes} [Thu Nov 11 16:55:00 2021] GET /identity/v3/role_assignments?user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0&scope.domain.id=default&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:01.668563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368522-eea5-4bcd-8012-e44ea2d3ae80 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:01.668849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368522-eea5-4bcd-8012-e44ea2d3ae80 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:01.669125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368522-eea5-4bcd-8012-e44ea2d3ae80 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:01.670916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 27/53] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:01.677256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754f09-6718-4ad4-ac5c-499232029839 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:01.677727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754f09-6718-4ad4-ac5c-499232029839 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:01.677824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba754f09-6718-4ad4-ac5c-499232029839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:01.695013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ba754f09-6718-4ad4-ac5c-499232029839 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:01.696207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ba754f09-6718-4ad4-ac5c-499232029839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:01.703607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:01.728769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82368522-eea5-4bcd-8012-e44ea2d3ae80 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:01.741947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82368522-eea5-4bcd-8012-e44ea2d3ae80 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:01.746377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f255126-def5-4a9d-9b08-50e5a553ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:01.747207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f255126-def5-4a9d-9b08-50e5a553ff43 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:01.747493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f255126-def5-4a9d-9b08-50e5a553ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:01.747772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f255126-def5-4a9d-9b08-50e5a553ff43 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:01.748997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f255126-def5-4a9d-9b08-50e5a553ff43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:01.750796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f255126-def5-4a9d-9b08-50e5a553ff43 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:01.752514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:01.758885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba754f09-6718-4ad4-ac5c-499232029839 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:01.768473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba754f09-6718-4ad4-ac5c-499232029839 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:01.772868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bb759-e556-40d9-ab53-506067edd165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:01.773519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bb759-e556-40d9-ab53-506067edd165 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:01.773802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bb759-e556-40d9-ab53-506067edd165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:01.774078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bb759-e556-40d9-ab53-506067edd165 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:01.774838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bb759-e556-40d9-ab53-506067edd165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:01.776769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bb759-e556-40d9-ab53-506067edd165 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:01.855279 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 28/56] 10.222.0.16 () {60 vars in 1161 bytes} [Thu Nov 11 16:55:01 2021] POST /identity/v3/projects => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:55:04.135036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5111c-e804-41d9-b171-ab02ec7b1ba4 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:04.135581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5111c-e804-41d9-b171-ab02ec7b1ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:04.135581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5111c-e804-41d9-b171-ab02ec7b1ba4 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:04.137342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 29/57] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:04.143320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d49da-2a84-4b50-ac59-b3e2de925996 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:04.143747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d49da-2a84-4b50-ac59-b3e2de925996 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:04.143881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d49da-2a84-4b50-ac59-b3e2de925996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:04.161325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-0f5d49da-2a84-4b50-ac59-b3e2de925996 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:04.162517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0f5d49da-2a84-4b50-ac59-b3e2de925996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:04.218658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 29/58] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:04.245508 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5111c-e804-41d9-b171-ab02ec7b1ba4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:04.258020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5111c-e804-41d9-b171-ab02ec7b1ba4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:04.262181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d235c9e-463b-4061-a68d-8df5850cfb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:04.262981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d235c9e-463b-4061-a68d-8df5850cfb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:04.263263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d235c9e-463b-4061-a68d-8df5850cfb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:04.263537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d235c9e-463b-4061-a68d-8df5850cfb37 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:04.264701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d235c9e-463b-4061-a68d-8df5850cfb37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:04.266382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d235c9e-463b-4061-a68d-8df5850cfb37 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:04.267986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:04.274183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d49da-2a84-4b50-ac59-b3e2de925996 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:04.283014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d49da-2a84-4b50-ac59-b3e2de925996 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:04.287327 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e2993-f5d1-48a0-be97-d65b2b43d959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:04.287984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e2993-f5d1-48a0-be97-d65b2b43d959 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:04.288268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e2993-f5d1-48a0-be97-d65b2b43d959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:04.288547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e2993-f5d1-48a0-be97-d65b2b43d959 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:04.289263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e2993-f5d1-48a0-be97-d65b2b43d959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:04.290276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-a03e2993-f5d1-48a0-be97-d65b2b43d959 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:04.290276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:55:04.290276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:55:04.291535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e2993-f5d1-48a0-be97-d65b2b43d959 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:04.375020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 30/60] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:04 2021] POST /identity/v3/users => generated 275 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:07.606125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893f6a6-6953-432c-9832-6f64bbdefac5 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:07.606690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893f6a6-6953-432c-9832-6f64bbdefac5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:07.606690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893f6a6-6953-432c-9832-6f64bbdefac5 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:07.608474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 31/61] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:07.624987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f9f2-8aa9-40f2-a662-c64ad7fbb91c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:07.625503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f9f2-8aa9-40f2-a662-c64ad7fbb91c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:07.625584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f9f2-8aa9-40f2-a662-c64ad7fbb91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:07.651534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7094f9f2-8aa9-40f2-a662-c64ad7fbb91c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:07.652750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7094f9f2-8aa9-40f2-a662-c64ad7fbb91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:07.661182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 31/62] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:07.699281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893f6a6-6953-432c-9832-6f64bbdefac5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:07.712405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893f6a6-6953-432c-9832-6f64bbdefac5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:07.718259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6699-1e8a-43d2-b025-8cff36ce9d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:07.719299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6699-1e8a-43d2-b025-8cff36ce9d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:07.719762 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6699-1e8a-43d2-b025-8cff36ce9d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:07.720754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f6699-1e8a-43d2-b025-8cff36ce9d6b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:07.740893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f6699-1e8a-43d2-b025-8cff36ce9d6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:07.748402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-5f5f6699-1e8a-43d2-b025-8cff36ce9d6b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:07.750183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 32/63] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:07.756422 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f9f2-8aa9-40f2-a662-c64ad7fbb91c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:07.770342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f9f2-8aa9-40f2-a662-c64ad7fbb91c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:07.783823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:07.784519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:07.784809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:07.785092 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:07.785881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:07.786194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:07.787525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:07.787525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:55:07.787525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:55:07.788571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:07.806430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 32/64] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:07.812235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6699-1e8a-43d2-b025-8cff36ce9d6b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:07.823485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f6699-1e8a-43d2-b025-8cff36ce9d6b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:07.835335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70066-306f-42f5-aacd-b780dc217667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:07.836556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70066-306f-42f5-aacd-b780dc217667 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:07.837049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70066-306f-42f5-aacd-b780dc217667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:07.837525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70066-306f-42f5-aacd-b780dc217667 admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:07.863560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70066-306f-42f5-aacd-b780dc217667 admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:07.866055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70066-306f-42f5-aacd-b780dc217667 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:07.868049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 33/65] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:07 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:07.875338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:07.901882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de629a-a730-4b4e-b9e6-516334c1f2ef admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:07.916667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ad51-0b70-4036-bfef-9b1153155797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:07.917342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ad51-0b70-4036-bfef-9b1153155797 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:07.917625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ad51-0b70-4036-bfef-9b1153155797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:07.917905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ad51-0b70-4036-bfef-9b1153155797 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:07.939944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ad51-0b70-4036-bfef-9b1153155797 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:07.941836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443ad51-0b70-4036-bfef-9b1153155797 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:07.957484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:07.964154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70066-306f-42f5-aacd-b780dc217667 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:07.980838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70066-306f-42f5-aacd-b780dc217667 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:07.992630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016217-a1b2-4bd3-9480-17f4d19e911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:07.993510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016217-a1b2-4bd3-9480-17f4d19e911b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:07.993792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016217-a1b2-4bd3-9480-17f4d19e911b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:07.994066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016217-a1b2-4bd3-9480-17f4d19e911b admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:07.999489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54016217-a1b2-4bd3-9480-17f4d19e911b admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.001668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54016217-a1b2-4bd3-9480-17f4d19e911b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.003562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 34/67] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:07 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.007873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e848f4-bf5e-4f5f-a883-dee003791934 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.008165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e848f4-bf5e-4f5f-a883-dee003791934 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.008451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e848f4-bf5e-4f5f-a883-dee003791934 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.009583 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016217-a1b2-4bd3-9480-17f4d19e911b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.010606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 34/68] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:08.019982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016217-a1b2-4bd3-9480-17f4d19e911b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.026723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3b037-adbc-4ca3-a7eb-e3545e8e414e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.027017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3b037-adbc-4ca3-a7eb-e3545e8e414e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.027301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3b037-adbc-4ca3-a7eb-e3545e8e414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.034230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.034931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.035212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.035490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.036335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] RBAC: Adding query filter params (role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=4b30188d19194873aed7f02c87d439bb, user.id=586f2ce919e340b9a2c07caa44e20460) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:08.036645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.038536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.052139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/role_assignments?user.id=586f2ce919e340b9a2c07caa44e20460&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=185d4a889ab64e4d84c11737116af86a => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:08.063302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e9a3b037-adbc-4ca3-a7eb-e3545e8e414e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:08.064607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e9a3b037-adbc-4ca3-a7eb-e3545e8e414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:08.078214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 35/70] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:08.124411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.135416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f092d80-dfe2-462a-aec2-34bf5092bd39 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.145383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e3a9-feb9-4bc4-a62c-f95237fb31a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.146206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e3a9-feb9-4bc4-a62c-f95237fb31a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.146494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e3a9-feb9-4bc4-a62c-f95237fb31a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.146798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e3a9-feb9-4bc4-a62c-f95237fb31a6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.164722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e3a9-feb9-4bc4-a62c-f95237fb31a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:08.171968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-c367e3a9-feb9-4bc4-a62c-f95237fb31a6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:08.173462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:08.179739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3b037-adbc-4ca3-a7eb-e3545e8e414e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.192586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3b037-adbc-4ca3-a7eb-e3545e8e414e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.201953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.202692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.202983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.203263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.204075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:08.204386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.206697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.218751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.224878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e3a9-feb9-4bc4-a62c-f95237fb31a6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.236007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e3a9-feb9-4bc4-a62c-f95237fb31a6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.247113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522010-d05b-4ce2-a6e4-76544fc20275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.248021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522010-d05b-4ce2-a6e4-76544fc20275 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.248305 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522010-d05b-4ce2-a6e4-76544fc20275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.248583 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f522010-d05b-4ce2-a6e4-76544fc20275 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.255645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f522010-d05b-4ce2-a6e4-76544fc20275 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.257659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f522010-d05b-4ce2-a6e4-76544fc20275 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.260088 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.266981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.284709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc22e-33ce-42a0-92f4-c6f054cf46e3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.293766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b28c9c-b106-4e9b-9133-5c94ca071cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.294463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b28c9c-b106-4e9b-9133-5c94ca071cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.294776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b28c9c-b106-4e9b-9133-5c94ca071cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.295058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b28c9c-b106-4e9b-9133-5c94ca071cfe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.312565 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b28c9c-b106-4e9b-9133-5c94ca071cfe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.314973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b28c9c-b106-4e9b-9133-5c94ca071cfe admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.328588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 37/74] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:08.336276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522010-d05b-4ce2-a6e4-76544fc20275 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.346915 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f522010-d05b-4ce2-a6e4-76544fc20275 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.354165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ddcc0-b91e-4fc9-89c6-db249f2d173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.355075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ddcc0-b91e-4fc9-89c6-db249f2d173d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.355360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ddcc0-b91e-4fc9-89c6-db249f2d173d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.355637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ddcc0-b91e-4fc9-89c6-db249f2d173d admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.359428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ddcc0-b91e-4fc9-89c6-db249f2d173d admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.361606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ddcc0-b91e-4fc9-89c6-db249f2d173d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.363842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.370361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b28c9c-b106-4e9b-9133-5c94ca071cfe admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.380163 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b28c9c-b106-4e9b-9133-5c94ca071cfe admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.391009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16c486-9dab-4c7f-95b3-48910b5f7446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.391681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16c486-9dab-4c7f-95b3-48910b5f7446 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.391965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16c486-9dab-4c7f-95b3-48910b5f7446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.392806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16c486-9dab-4c7f-95b3-48910b5f7446 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.393656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16c486-9dab-4c7f-95b3-48910b5f7446 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=4b30188d19194873aed7f02c87d439bb, user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:08.393969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16c486-9dab-4c7f-95b3-48910b5f7446 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.395857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16c486-9dab-4c7f-95b3-48910b5f7446 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.406996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 38/76] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/role_assignments?user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.433570 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c0ebe-b9d1-491c-955b-5638d1edf74c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.433917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c0ebe-b9d1-491c-955b-5638d1edf74c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.434121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c0ebe-b9d1-491c-955b-5638d1edf74c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.436369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 39/77] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:08.443473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670a7f-d90d-4250-bb5c-d2dd9ce0fa31 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.443827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670a7f-d90d-4250-bb5c-d2dd9ce0fa31 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.444033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670a7f-d90d-4250-bb5c-d2dd9ce0fa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.475773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-95670a7f-d90d-4250-bb5c-d2dd9ce0fa31 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:08.477064 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-95670a7f-d90d-4250-bb5c-d2dd9ce0fa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:08.485596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 39/78] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:08.523447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c0ebe-b9d1-491c-955b-5638d1edf74c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.540403 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c0ebe-b9d1-491c-955b-5638d1edf74c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.545598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbd9ee-ad21-46e7-9c90-5d8e75c62738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.546422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbd9ee-ad21-46e7-9c90-5d8e75c62738 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.546730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbd9ee-ad21-46e7-9c90-5d8e75c62738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.547009 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbd9ee-ad21-46e7-9c90-5d8e75c62738 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.569401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbd9ee-ad21-46e7-9c90-5d8e75c62738 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:08.576710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-99fbd9ee-ad21-46e7-9c90-5d8e75c62738 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:08.578177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:08.584838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670a7f-d90d-4250-bb5c-d2dd9ce0fa31 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.597448 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670a7f-d90d-4250-bb5c-d2dd9ce0fa31 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.602383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbd8c3-22e8-4f61-9424-d4d1cd6beb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.603116 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbd8c3-22e8-4f61-9424-d4d1cd6beb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.603410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbd8c3-22e8-4f61-9424-d4d1cd6beb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.603692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbd8c3-22e8-4f61-9424-d4d1cd6beb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.604494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbd8c3-22e8-4f61-9424-d4d1cd6beb5a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:08.604808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbd8c3-22e8-4f61-9424-d4d1cd6beb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.606488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbd8c3-22e8-4f61-9424-d4d1cd6beb5a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.625051 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 40/80] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.632295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbd9ee-ad21-46e7-9c90-5d8e75c62738 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.641676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd22d0-5522-451f-888f-6b65e8acdd19 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.641975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd22d0-5522-451f-888f-6b65e8acdd19 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.642276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd22d0-5522-451f-888f-6b65e8acdd19 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.642850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbd9ee-ad21-46e7-9c90-5d8e75c62738 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.644471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 41/81] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:08 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:08.645819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6badea-bddc-42a8-bbd0-dc85d0df357c None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.646340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6badea-bddc-42a8-bbd0-dc85d0df357c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.646785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6badea-bddc-42a8-bbd0-dc85d0df357c None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.647876 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00b220-e99b-4f8a-a764-1f944ae2986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.648745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b220-e99b-4f8a-a764-1f944ae2986d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.653826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 42/82] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:08.653944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b220-e99b-4f8a-a764-1f944ae2986d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.653944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b220-e99b-4f8a-a764-1f944ae2986d admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.655041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804de47-eac6-4e57-973a-f995b4a74064 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.655162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b220-e99b-4f8a-a764-1f944ae2986d admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.655345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804de47-eac6-4e57-973a-f995b4a74064 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.655628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804de47-eac6-4e57-973a-f995b4a74064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.657372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b220-e99b-4f8a-a764-1f944ae2986d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.659344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.660682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782543d-7583-4370-ac5d-58f748bc03ac None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.661105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782543d-7583-4370-ac5d-58f748bc03ac None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.661540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782543d-7583-4370-ac5d-58f748bc03ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.678513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-2804de47-eac6-4e57-973a-f995b4a74064 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:08.679750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2804de47-eac6-4e57-973a-f995b4a74064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:08.680967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3782543d-7583-4370-ac5d-58f748bc03ac None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:08.682240 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3782543d-7583-4370-ac5d-58f748bc03ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:08.688262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 43/84] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:08.690039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804de47-eac6-4e57-973a-f995b4a74064 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.691913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 42/85] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:08.702965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804de47-eac6-4e57-973a-f995b4a74064 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.714997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de7b4-7e34-4e08-bf88-a0dbb00ac672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.716143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de7b4-7e34-4e08-bf88-a0dbb00ac672 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.716655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de7b4-7e34-4e08-bf88-a0dbb00ac672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.717130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6de7b4-7e34-4e08-bf88-a0dbb00ac672 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.720353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782543d-7583-4370-ac5d-58f748bc03ac None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.729825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782543d-7583-4370-ac5d-58f748bc03ac None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.733663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6de7b4-7e34-4e08-bf88-a0dbb00ac672 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.735288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c58992-58a4-44ea-bf6b-f589befc2c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.736714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58992-58a4-44ea-bf6b-f589befc2c5a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.736993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6de7b4-7e34-4e08-bf88-a0dbb00ac672 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.737194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58992-58a4-44ea-bf6b-f589befc2c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.737786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58992-58a4-44ea-bf6b-f589befc2c5a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.739100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c58992-58a4-44ea-bf6b-f589befc2c5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.740937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c58992-58a4-44ea-bf6b-f589befc2c5a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.747978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 43/86] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:08.747978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c58992-58a4-44ea-bf6b-f589befc2c5a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.754357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 44/87] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:08.755444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de7b4-7e34-4e08-bf88-a0dbb00ac672 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.763427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c58992-58a4-44ea-bf6b-f589befc2c5a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.771947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654db1b-bccf-44b7-bf5e-000926ca689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.772118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6de7b4-7e34-4e08-bf88-a0dbb00ac672 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.773489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654db1b-bccf-44b7-bf5e-000926ca689b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.773985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654db1b-bccf-44b7-bf5e-000926ca689b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.774505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654db1b-bccf-44b7-bf5e-000926ca689b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.776488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d60c-5174-4306-b08d-e0495b4d30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.777144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d60c-5174-4306-b08d-e0495b4d30cf admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.777608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d60c-5174-4306-b08d-e0495b4d30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.777712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d60c-5174-4306-b08d-e0495b4d30cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.778413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635d60c-5174-4306-b08d-e0495b4d30cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.780389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635d60c-5174-4306-b08d-e0495b4d30cf admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.790063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654db1b-bccf-44b7-bf5e-000926ca689b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:08.799966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-1654db1b-bccf-44b7-bf5e-000926ca689b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:08.801536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 44/88] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:08.807323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654db1b-bccf-44b7-bf5e-000926ca689b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.819104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654db1b-bccf-44b7-bf5e-000926ca689b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.823518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f9d74-96c2-4c51-9439-89ecabae862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.824406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f9d74-96c2-4c51-9439-89ecabae862e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.824694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f9d74-96c2-4c51-9439-89ecabae862e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.824970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f9d74-96c2-4c51-9439-89ecabae862e admin admin] PATH_INFO: `/v3/projects/228f82a87402494091419a53baea360a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.826151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f9d74-96c2-4c51-9439-89ecabae862e admin admin] RBAC: Authorizing `identity:get_project(project_id=228f82a87402494091419a53baea360a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.828269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f9d74-96c2-4c51-9439-89ecabae862e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.834603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 45/89] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/projects/228f82a87402494091419a53baea360a => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.834603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f9d74-96c2-4c51-9439-89ecabae862e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.853270 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f9d74-96c2-4c51-9439-89ecabae862e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:08.860765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:08.860765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:08.860765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:08.860765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:08.861143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:08.861143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:08.861763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:08.876140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 45/90] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:55:08 2021] POST /identity/v3/projects => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:08.882879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d60c-5174-4306-b08d-e0495b4d30cf admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.887102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 46/91] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:08.895966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:08.915032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9b316-b513-49a8-b037-5e3bc3bbdb89 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:09.010217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d60c-5174-4306-b08d-e0495b4d30cf admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:09.019864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:09.020549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:09.020838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:09.021122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:09.021990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] RBAC: Adding query filter params (role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=228f82a87402494091419a53baea360a, user.id=586f2ce919e340b9a2c07caa44e20460) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:09.022315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:09.024253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:09.031351 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d6b13-1008-4525-84a3-5d5dd39f5c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:09.032259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d6b13-1008-4525-84a3-5d5dd39f5c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:09.032549 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d6b13-1008-4525-84a3-5d5dd39f5c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:09.032874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d6b13-1008-4525-84a3-5d5dd39f5c61 admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:09.034206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d6b13-1008-4525-84a3-5d5dd39f5c61 admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:09.036801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d6b13-1008-4525-84a3-5d5dd39f5c61 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:09.036964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/role_assignments?user.id=586f2ce919e340b9a2c07caa44e20460&scope.project.id=228f82a87402494091419a53baea360a&role.id=185d4a889ab64e4d84c11737116af86a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:09.038243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 47/93] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:08 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:09.045236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:09.056232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96763221-6b98-479b-812b-7d0df688801b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:09.061387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48331-c310-463b-b08d-99c061e017e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:09.062266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48331-c310-463b-b08d-99c061e017e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:09.062701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48331-c310-463b-b08d-99c061e017e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:09.063123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48331-c310-463b-b08d-99c061e017e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:09.073677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48331-c310-463b-b08d-99c061e017e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:09.075853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48331-c310-463b-b08d-99c061e017e0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:09.090999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 47/94] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:09.097957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d6b13-1008-4525-84a3-5d5dd39f5c61 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:09.121889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d6b13-1008-4525-84a3-5d5dd39f5c61 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:09.135592 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566bc0f-efd6-4586-9c6c-d9ece5480b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:09.136439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566bc0f-efd6-4586-9c6c-d9ece5480b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:09.136724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566bc0f-efd6-4586-9c6c-d9ece5480b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:09.137000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566bc0f-efd6-4586-9c6c-d9ece5480b9c admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:09.138448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566bc0f-efd6-4586-9c6c-d9ece5480b9c admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:09.140613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566bc0f-efd6-4586-9c6c-d9ece5480b9c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:09.143190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 48/95] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:09 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:09.149783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48331-c310-463b-b08d-99c061e017e0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:09.162143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48331-c310-463b-b08d-99c061e017e0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:09.169623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787af22-9ce2-48f5-b05c-0b2c48929ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:09.170305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787af22-9ce2-48f5-b05c-0b2c48929ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:09.170657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787af22-9ce2-48f5-b05c-0b2c48929ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:09.170947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787af22-9ce2-48f5-b05c-0b2c48929ba7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:09.171917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787af22-9ce2-48f5-b05c-0b2c48929ba7 admin admin] RBAC: Adding query filter params (role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=4b30188d19194873aed7f02c87d439bb, user.id=586f2ce919e340b9a2c07caa44e20460) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:09.172238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787af22-9ce2-48f5-b05c-0b2c48929ba7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:09.174410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787af22-9ce2-48f5-b05c-0b2c48929ba7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:09.187427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 48/96] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:09 2021] GET /identity/v3/role_assignments?user.id=586f2ce919e340b9a2c07caa44e20460&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:10.866676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2d1f-3d27-4137-b032-9c0e8ab4381c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:10.867199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2d1f-3d27-4137-b032-9c0e8ab4381c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:10.867308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2d1f-3d27-4137-b032-9c0e8ab4381c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:10.869173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 49/97] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:10.892713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6edee-8f57-4f36-9d5a-bb254279742b None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:10.893338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6edee-8f57-4f36-9d5a-bb254279742b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:10.893338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6edee-8f57-4f36-9d5a-bb254279742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:10.915337 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-aae6edee-8f57-4f36-9d5a-bb254279742b None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:10.916565 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-aae6edee-8f57-4f36-9d5a-bb254279742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:10.925110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 49/98] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:10.962662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2d1f-3d27-4137-b032-9c0e8ab4381c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:10.985861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2d1f-3d27-4137-b032-9c0e8ab4381c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:10.996037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c57c-929f-4b81-b6ed-bd02e030b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:10.996836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c57c-929f-4b81-b6ed-bd02e030b3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:10.997116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c57c-929f-4b81-b6ed-bd02e030b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:10.997389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c57c-929f-4b81-b6ed-bd02e030b3f1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.013136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9c57c-929f-4b81-b6ed-bd02e030b3f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:11.020306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-d0f9c57c-929f-4b81-b6ed-bd02e030b3f1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:11.021506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 50/99] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:11.028420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6edee-8f57-4f36-9d5a-bb254279742b None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.039353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6edee-8f57-4f36-9d5a-bb254279742b None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.049483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab3334-5573-4776-a6ca-3d1d491995f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.050155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3334-5573-4776-a6ca-3d1d491995f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.050432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3334-5573-4776-a6ca-3d1d491995f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.050730 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab3334-5573-4776-a6ca-3d1d491995f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.051500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab3334-5573-4776-a6ca-3d1d491995f1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:11.051803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab3334-5573-4776-a6ca-3d1d491995f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:11.053427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab3334-5573-4776-a6ca-3d1d491995f1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:11.066668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 50/100] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:11.074319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c57c-929f-4b81-b6ed-bd02e030b3f1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.088199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c57c-929f-4b81-b6ed-bd02e030b3f1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.097212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca437b-9ccf-46af-bbae-9285f77d1199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.098091 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca437b-9ccf-46af-bbae-9285f77d1199 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.098371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca437b-9ccf-46af-bbae-9285f77d1199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.098668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca437b-9ccf-46af-bbae-9285f77d1199 admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.100127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca437b-9ccf-46af-bbae-9285f77d1199 admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:11.102389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca437b-9ccf-46af-bbae-9285f77d1199 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:11.105102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47f88a-b313-425c-b0c3-372979b701d5 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.105386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47f88a-b313-425c-b0c3-372979b701d5 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.105663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47f88a-b313-425c-b0c3-372979b701d5 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.107545 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 51/101] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:55:11.110783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 51/102] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:11 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:11.116636 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c684d-fa1f-41dc-95ef-7792746c759d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.117054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c684d-fa1f-41dc-95ef-7792746c759d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.117283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c684d-fa1f-41dc-95ef-7792746c759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.123495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca437b-9ccf-46af-bbae-9285f77d1199 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.135529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca437b-9ccf-46af-bbae-9285f77d1199 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.142779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-902c684d-fa1f-41dc-95ef-7792746c759d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:11.143985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-902c684d-fa1f-41dc-95ef-7792746c759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:11.145492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806b98-1509-4f59-bd98-8eff1a3aa85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.146432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806b98-1509-4f59-bd98-8eff1a3aa85d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.146762 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806b98-1509-4f59-bd98-8eff1a3aa85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.147045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7806b98-1509-4f59-bd98-8eff1a3aa85d admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.148654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7806b98-1509-4f59-bd98-8eff1a3aa85d admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:11.152770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7806b98-1509-4f59-bd98-8eff1a3aa85d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:11.157010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 52/103] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:11 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:11.163545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806b98-1509-4f59-bd98-8eff1a3aa85d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.165041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 52/104] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:11.186756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7806b98-1509-4f59-bd98-8eff1a3aa85d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.188878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c684d-fa1f-41dc-95ef-7792746c759d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.199259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e66590-fdce-4e37-81d4-b33f21961030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.202156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e66590-fdce-4e37-81d4-b33f21961030 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.203089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c684d-fa1f-41dc-95ef-7792746c759d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.203841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e66590-fdce-4e37-81d4-b33f21961030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.204125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e66590-fdce-4e37-81d4-b33f21961030 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb/users/586f2ce919e340b9a2c07caa44e20460/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.206826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e66590-fdce-4e37-81d4-b33f21961030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b30188d19194873aed7f02c87d439bb, user_id=586f2ce919e340b9a2c07caa44e20460, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:11.210436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e66590-fdce-4e37-81d4-b33f21961030 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:11.215180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55362f7-42d7-432c-a034-89461782f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.215992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55362f7-42d7-432c-a034-89461782f6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.216274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55362f7-42d7-432c-a034-89461782f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.216549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55362f7-42d7-432c-a034-89461782f6cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.229451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55362f7-42d7-432c-a034-89461782f6cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:11.237940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-b55362f7-42d7-432c-a034-89461782f6cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:11.239523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 53/105] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:11.251161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55362f7-42d7-432c-a034-89461782f6cb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.257716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55362f7-42d7-432c-a034-89461782f6cb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.262823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.263738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.264170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.264593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.265590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:11.266044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:11.268658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:11.278364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 54/106] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:11.286291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.296656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1a450-3c34-44e6-be10-39fa1843de60 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.301716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5d50-a155-4580-aa7c-7ee6b78bba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.302948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5d50-a155-4580-aa7c-7ee6b78bba3c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.303409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5d50-a155-4580-aa7c-7ee6b78bba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.303850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5d50-a155-4580-aa7c-7ee6b78bba3c admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.305356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e5d50-a155-4580-aa7c-7ee6b78bba3c admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:11.307511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e5d50-a155-4580-aa7c-7ee6b78bba3c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:11.309709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 55/107] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:11 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:11.316727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5d50-a155-4580-aa7c-7ee6b78bba3c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.321358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 53/108] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:11 2021] PUT /identity/v3/projects/4b30188d19194873aed7f02c87d439bb/users/586f2ce919e340b9a2c07caa44e20460/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:11.328190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5d50-a155-4580-aa7c-7ee6b78bba3c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.394373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e61acf-cb40-4879-9b81-f6f1bd1caaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.395557 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61acf-cb40-4879-9b81-f6f1bd1caaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.396024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61acf-cb40-4879-9b81-f6f1bd1caaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.396444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61acf-cb40-4879-9b81-f6f1bd1caaf6 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.397860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e61acf-cb40-4879-9b81-f6f1bd1caaf6 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:11.400254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e61acf-cb40-4879-9b81-f6f1bd1caaf6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:11.402600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 56/109] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:11 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:11.409585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e66590-fdce-4e37-81d4-b33f21961030 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:11.420364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e66590-fdce-4e37-81d4-b33f21961030 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:11.425689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e17393-827a-48e0-a997-39b36464ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:11.426945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17393-827a-48e0-a997-39b36464ba3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.427488 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17393-827a-48e0-a997-39b36464ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.427942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17393-827a-48e0-a997-39b36464ba3c admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.430252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e17393-827a-48e0-a997-39b36464ba3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b30188d19194873aed7f02c87d439bb, user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:11.433305 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e17393-827a-48e0-a997-39b36464ba3c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:11.532614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 54/110] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:11 2021] PUT /identity/v3/projects/4b30188d19194873aed7f02c87d439bb/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:11.890209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e708-2c46-45bd-9414-fb5cc9ccba44 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.890826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e708-2c46-45bd-9414-fb5cc9ccba44 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.891291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e708-2c46-45bd-9414-fb5cc9ccba44 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.893877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 57/111] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:11.901710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c10245-e29e-4795-97bd-3b37de9b3a16 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.902178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c10245-e29e-4795-97bd-3b37de9b3a16 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.902276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c10245-e29e-4795-97bd-3b37de9b3a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.926658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-23c10245-e29e-4795-97bd-3b37de9b3a16 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:11.931895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-23c10245-e29e-4795-97bd-3b37de9b3a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:11.945037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92456d2-f1ab-43dc-87cb-ece4122cc2c7 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.945472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92456d2-f1ab-43dc-87cb-ece4122cc2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.945856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92456d2-f1ab-43dc-87cb-ece4122cc2c7 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.947909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 58/112] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:55:11.954468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d456e1-b281-4a76-8266-65b1fce894a1 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:11.955045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d456e1-b281-4a76-8266-65b1fce894a1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:11.955434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d456e1-b281-4a76-8266-65b1fce894a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:11.993504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a6d456e1-b281-4a76-8266-65b1fce894a1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:11.995358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a6d456e1-b281-4a76-8266-65b1fce894a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:12.078650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 59/113] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:12.092385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 55/114] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:12.103857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d456e1-b281-4a76-8266-65b1fce894a1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.115075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d456e1-b281-4a76-8266-65b1fce894a1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.118820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4858-8ae5-4484-a85c-7ec02e83005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.119643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4858-8ae5-4484-a85c-7ec02e83005f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.119929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4858-8ae5-4484-a85c-7ec02e83005f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.120208 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4858-8ae5-4484-a85c-7ec02e83005f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.132268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed4858-8ae5-4484-a85c-7ec02e83005f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:12.140290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-00ed4858-8ae5-4484-a85c-7ec02e83005f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:12.141466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 60/115] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:12.148042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c10245-e29e-4795-97bd-3b37de9b3a16 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.158511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c10245-e29e-4795-97bd-3b37de9b3a16 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.160557 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4858-8ae5-4484-a85c-7ec02e83005f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.170452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfe44f-4eac-49f6-b675-994505f05f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.171171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfe44f-4eac-49f6-b675-994505f05f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.171458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfe44f-4eac-49f6-b675-994505f05f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.171737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfe44f-4eac-49f6-b675-994505f05f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.172509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfe44f-4eac-49f6-b675-994505f05f71 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:12.177599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfe44f-4eac-49f6-b675-994505f05f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.177599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfe44f-4eac-49f6-b675-994505f05f71 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.178465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4858-8ae5-4484-a85c-7ec02e83005f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.183236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9652f7-4715-4fd1-8027-eecdd0201eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.184049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9652f7-4715-4fd1-8027-eecdd0201eed admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.184524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9652f7-4715-4fd1-8027-eecdd0201eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.184953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 56/116] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:12.185063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9652f7-4715-4fd1-8027-eecdd0201eed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.186328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51533-b280-4d8e-977a-83bc855a0cba None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.193308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51533-b280-4d8e-977a-83bc855a0cba None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.193668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51533-b280-4d8e-977a-83bc855a0cba None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.195687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 57/117] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:12 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:12.196438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51533-b280-4d8e-977a-83bc855a0cba None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.196803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9652f7-4715-4fd1-8027-eecdd0201eed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:12.208767 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-de9652f7-4715-4fd1-8027-eecdd0201eed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:12.210285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 61/118] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:12.211555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0119f-9b1e-4a5e-936d-061722b59b96 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.211732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51533-b280-4d8e-977a-83bc855a0cba None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.211836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0119f-9b1e-4a5e-936d-061722b59b96 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.212105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0119f-9b1e-4a5e-936d-061722b59b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.217148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177f03f-b5ba-47e3-a784-c4f0558b3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.220208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177f03f-b5ba-47e3-a784-c4f0558b3b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.220208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177f03f-b5ba-47e3-a784-c4f0558b3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.220208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177f03f-b5ba-47e3-a784-c4f0558b3b7d admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.220208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177f03f-b5ba-47e3-a784-c4f0558b3b7d admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.223253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177f03f-b5ba-47e3-a784-c4f0558b3b7d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.224984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 58/119] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:12.225754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177f03f-b5ba-47e3-a784-c4f0558b3b7d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.232010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e4b0119f-9b1e-4a5e-936d-061722b59b96 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:12.233211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e4b0119f-9b1e-4a5e-936d-061722b59b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:12.244752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177f03f-b5ba-47e3-a784-c4f0558b3b7d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.246783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 62/120] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:12.250635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0119f-9b1e-4a5e-936d-061722b59b96 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.258756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.259438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.259727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.260007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.260774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:12.261084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.262760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.266385 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0119f-9b1e-4a5e-936d-061722b59b96 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.276452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f3a73-15d0-4416-85e1-4913495a9468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.277486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f3a73-15d0-4416-85e1-4913495a9468 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.277777 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f3a73-15d0-4416-85e1-4913495a9468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.278105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f3a73-15d0-4416-85e1-4913495a9468 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.279614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f3a73-15d0-4416-85e1-4913495a9468 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.282671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 59/121] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:12.284876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f3a73-15d0-4416-85e1-4913495a9468 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.285648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.286941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 63/122] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:12.293189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f3a73-15d0-4416-85e1-4913495a9468 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.296748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca67e-bf9b-4ff5-b956-5ee93cb75736 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.302533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c33d3d-8161-419f-855e-ca17ea17237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.303580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33d3d-8161-419f-855e-ca17ea17237d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.303684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f3a73-15d0-4416-85e1-4913495a9468 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.306151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33d3d-8161-419f-855e-ca17ea17237d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.306151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33d3d-8161-419f-855e-ca17ea17237d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.306151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c33d3d-8161-419f-855e-ca17ea17237d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.308365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c33d3d-8161-419f-855e-ca17ea17237d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.308921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad25e-e5f2-4f3a-b814-891e6f0714b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.309956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad25e-e5f2-4f3a-b814-891e6f0714b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.310311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad25e-e5f2-4f3a-b814-891e6f0714b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.310717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ad25e-e5f2-4f3a-b814-891e6f0714b8 admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.310962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 60/123] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:12.316309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ad25e-e5f2-4f3a-b814-891e6f0714b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.316309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ad25e-e5f2-4f3a-b814-891e6f0714b8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.316515 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 64/124] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:12.317325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad25e-e5f2-4f3a-b814-891e6f0714b8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.317505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c33d3d-8161-419f-855e-ca17ea17237d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.328464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c33d3d-8161-419f-855e-ca17ea17237d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.329498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ad25e-e5f2-4f3a-b814-891e6f0714b8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.336025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527e1f-d275-4b82-81bf-cd782d77e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.336729 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f7fa-9a93-4020-9ab3-0369b3d41128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.336847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527e1f-d275-4b82-81bf-cd782d77e8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.337248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527e1f-d275-4b82-81bf-cd782d77e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.337665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527e1f-d275-4b82-81bf-cd782d77e8f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.338363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f7fa-9a93-4020-9ab3-0369b3d41128 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.338511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46527e1f-d275-4b82-81bf-cd782d77e8f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.338971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f7fa-9a93-4020-9ab3-0369b3d41128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.339466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f7fa-9a93-4020-9ab3-0369b3d41128 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb/users/586f2ce919e340b9a2c07caa44e20460/roles/c6ba186164fa477bb92f50bf3180c74d` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.342006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97f7fa-9a93-4020-9ab3-0369b3d41128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b30188d19194873aed7f02c87d439bb, user_id=586f2ce919e340b9a2c07caa44e20460, role_id=c6ba186164fa477bb92f50bf3180c74d)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.342205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46527e1f-d275-4b82-81bf-cd782d77e8f2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.345217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97f7fa-9a93-4020-9ab3-0369b3d41128 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.421592 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 61/125] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:12 2021] PUT /identity/v3/projects/4b30188d19194873aed7f02c87d439bb/users/586f2ce919e340b9a2c07caa44e20460/roles/c6ba186164fa477bb92f50bf3180c74d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:12.429840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f7fa-9a93-4020-9ab3-0369b3d41128 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.435647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 65/126] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:12 2021] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:55:12.528621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f7fa-9a93-4020-9ab3-0369b3d41128 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.534824 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0619011-0c2f-4841-89d6-3d6f280debbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.535718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619011-0c2f-4841-89d6-3d6f280debbd admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.535997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619011-0c2f-4841-89d6-3d6f280debbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.536268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0619011-0c2f-4841-89d6-3d6f280debbd admin admin] PATH_INFO: `/v3/projects/228f82a87402494091419a53baea360a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.540895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0619011-0c2f-4841-89d6-3d6f280debbd admin admin] RBAC: Authorizing `identity:get_project(project_id=228f82a87402494091419a53baea360a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.543073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0619011-0c2f-4841-89d6-3d6f280debbd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.544896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 62/127] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:12 2021] GET /identity/v3/projects/228f82a87402494091419a53baea360a => generated 312 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:12.551846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527e1f-d275-4b82-81bf-cd782d77e8f2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:12.562588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527e1f-d275-4b82-81bf-cd782d77e8f2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:12.571019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bd34d-100d-43f1-9fe2-22d375a98f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:12.571992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd34d-100d-43f1-9fe2-22d375a98f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:12.572272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd34d-100d-43f1-9fe2-22d375a98f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:12.572547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd34d-100d-43f1-9fe2-22d375a98f7e admin admin] PATH_INFO: `/v3/projects/228f82a87402494091419a53baea360a/users/586f2ce919e340b9a2c07caa44e20460/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:12.577374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bd34d-100d-43f1-9fe2-22d375a98f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=228f82a87402494091419a53baea360a, user_id=586f2ce919e340b9a2c07caa44e20460, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:12.577374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-7a3bd34d-100d-43f1-9fe2-22d375a98f7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:12.577374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:55:12.577374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:55:12.579464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bd34d-100d-43f1-9fe2-22d375a98f7e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:12.665518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 66/128] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:12 2021] PUT /identity/v3/projects/228f82a87402494091419a53baea360a/users/586f2ce919e340b9a2c07caa44e20460/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:14.232067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ad117-9cf8-4f86-8b6e-f50a0cc51bc1 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:14.232567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ad117-9cf8-4f86-8b6e-f50a0cc51bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:14.232672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ad117-9cf8-4f86-8b6e-f50a0cc51bc1 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:14.234433 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 63/129] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:14.241411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f37d-1a15-490e-9a49-f6e47f55d87a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:14.241917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f37d-1a15-490e-9a49-f6e47f55d87a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:14.241988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f37d-1a15-490e-9a49-f6e47f55d87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:14.268213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c335f37d-1a15-490e-9a49-f6e47f55d87a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:14.269426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c335f37d-1a15-490e-9a49-f6e47f55d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:14.346782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 67/130] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:14.399415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ad117-9cf8-4f86-8b6e-f50a0cc51bc1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:14.416475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ad117-9cf8-4f86-8b6e-f50a0cc51bc1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:14.423899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c602-7e1a-4e6e-b155-1d6aa435c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:14.424708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c602-7e1a-4e6e-b155-1d6aa435c665 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:14.424989 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c602-7e1a-4e6e-b155-1d6aa435c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:14.425259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c602-7e1a-4e6e-b155-1d6aa435c665 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:14.441979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36c602-7e1a-4e6e-b155-1d6aa435c665 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:14.449233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-fa36c602-7e1a-4e6e-b155-1d6aa435c665 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:14.450485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:14.457846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335f37d-1a15-490e-9a49-f6e47f55d87a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:14.467452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335f37d-1a15-490e-9a49-f6e47f55d87a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:14.477992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:14.478707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:14.478991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:14.479331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:14.480119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:14.480424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:14.482111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:14.492213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:14.498579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c602-7e1a-4e6e-b155-1d6aa435c665 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:14.510105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c602-7e1a-4e6e-b155-1d6aa435c665 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:14.515790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6fc77-d80f-46f8-a9c5-0f5b9a74cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:14.516736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6fc77-d80f-46f8-a9c5-0f5b9a74cb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:14.517019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6fc77-d80f-46f8-a9c5-0f5b9a74cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:14.517292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6fc77-d80f-46f8-a9c5-0f5b9a74cb49 admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:14.523372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6fc77-d80f-46f8-a9c5-0f5b9a74cb49 admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:14.525575 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6fc77-d80f-46f8-a9c5-0f5b9a74cb49 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:14.527597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 65/133] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:14 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:14.533509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:14.544072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5ed3-70b8-4b02-90ab-1cc02cc63b42 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:14.551942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff89a3c-8717-4449-9c2d-e7ce2502523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:14.552610 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89a3c-8717-4449-9c2d-e7ce2502523d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:14.552890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89a3c-8717-4449-9c2d-e7ce2502523d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:14.553227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89a3c-8717-4449-9c2d-e7ce2502523d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:14.561980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff89a3c-8717-4449-9c2d-e7ce2502523d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:14.563789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff89a3c-8717-4449-9c2d-e7ce2502523d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:14.574594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 69/134] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:14.579952 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6fc77-d80f-46f8-a9c5-0f5b9a74cb49 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:14.590106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6fc77-d80f-46f8-a9c5-0f5b9a74cb49 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:14.596627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d9423-50ad-4b2b-8f28-d93d6084c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:14.597595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d9423-50ad-4b2b-8f28-d93d6084c936 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:14.597876 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d9423-50ad-4b2b-8f28-d93d6084c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:14.598147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d9423-50ad-4b2b-8f28-d93d6084c936 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:14.599422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d9423-50ad-4b2b-8f28-d93d6084c936 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:14.601657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d9423-50ad-4b2b-8f28-d93d6084c936 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:14.603410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 66/135] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:14 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:14.610173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff89a3c-8717-4449-9c2d-e7ce2502523d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:14.620663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff89a3c-8717-4449-9c2d-e7ce2502523d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:14.626920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e46613-c394-45ac-a2ba-2253937ef4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:14.628149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46613-c394-45ac-a2ba-2253937ef4de admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:14.628435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46613-c394-45ac-a2ba-2253937ef4de admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:14.628756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46613-c394-45ac-a2ba-2253937ef4de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:14.629612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46613-c394-45ac-a2ba-2253937ef4de admin admin] RBAC: Adding query filter params (role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=4b30188d19194873aed7f02c87d439bb, user.id=586f2ce919e340b9a2c07caa44e20460) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:14.629924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46613-c394-45ac-a2ba-2253937ef4de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:14.631885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e46613-c394-45ac-a2ba-2253937ef4de admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:14.638525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 70/136] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:14 2021] GET /identity/v3/role_assignments?user.id=586f2ce919e340b9a2c07caa44e20460&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=185d4a889ab64e4d84c11737116af86a => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:15.319440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a2101-ebe9-4e8b-9071-5b82ea1a82f7 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.320118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a2101-ebe9-4e8b-9071-5b82ea1a82f7 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.320118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a2101-ebe9-4e8b-9071-5b82ea1a82f7 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.321736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 67/137] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:15.336524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4a2b6-2855-4f2c-a83b-1cbcc1ceec53 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.337060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4a2b6-2855-4f2c-a83b-1cbcc1ceec53 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.337060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4a2b6-2855-4f2c-a83b-1cbcc1ceec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.359677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5cd4a2b6-2855-4f2c-a83b-1cbcc1ceec53 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:15.360920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5cd4a2b6-2855-4f2c-a83b-1cbcc1ceec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:15.372962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 71/138] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:15.415956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a2101-ebe9-4e8b-9071-5b82ea1a82f7 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.432023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a2101-ebe9-4e8b-9071-5b82ea1a82f7 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.442041 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd24c1-3d67-44ef-9a3e-bd1bac0e2209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.442868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd24c1-3d67-44ef-9a3e-bd1bac0e2209 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.443147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd24c1-3d67-44ef-9a3e-bd1bac0e2209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.443421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd24c1-3d67-44ef-9a3e-bd1bac0e2209 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.459430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd24c1-3d67-44ef-9a3e-bd1bac0e2209 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:15.466423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-cbcd24c1-3d67-44ef-9a3e-bd1bac0e2209 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:15.467652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 68/139] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:15.474606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4a2b6-2855-4f2c-a83b-1cbcc1ceec53 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.483699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4a2b6-2855-4f2c-a83b-1cbcc1ceec53 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.490842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.491569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.491850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.492168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.492939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:15.493245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:15.495025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:15.504187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 72/140] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:15.510246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd24c1-3d67-44ef-9a3e-bd1bac0e2209 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.520778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd24c1-3d67-44ef-9a3e-bd1bac0e2209 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.525294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325263e-56cd-4e9a-b5e3-6faff5bdfd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.526231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325263e-56cd-4e9a-b5e3-6faff5bdfd79 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.526588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325263e-56cd-4e9a-b5e3-6faff5bdfd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.526874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325263e-56cd-4e9a-b5e3-6faff5bdfd79 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.528227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325263e-56cd-4e9a-b5e3-6faff5bdfd79 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:15.530166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325263e-56cd-4e9a-b5e3-6faff5bdfd79 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:15.532352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 69/141] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:15.539212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.549635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f6b44-b184-4a6f-af9f-886576a4cba5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.554414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1ad02-cac3-471f-a529-a9eceb3b9395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.555186 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1ad02-cac3-471f-a529-a9eceb3b9395 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.555470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1ad02-cac3-471f-a529-a9eceb3b9395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.555745 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1ad02-cac3-471f-a529-a9eceb3b9395 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.565138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1ad02-cac3-471f-a529-a9eceb3b9395 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:15.567056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1ad02-cac3-471f-a529-a9eceb3b9395 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:15.576766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 73/142] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:15.583545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325263e-56cd-4e9a-b5e3-6faff5bdfd79 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.594712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325263e-56cd-4e9a-b5e3-6faff5bdfd79 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.600230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee58730-33ed-4873-b7fc-dccafc91e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.601094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58730-33ed-4873-b7fc-dccafc91e419 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.601417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58730-33ed-4873-b7fc-dccafc91e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.601694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee58730-33ed-4873-b7fc-dccafc91e419 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.602970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee58730-33ed-4873-b7fc-dccafc91e419 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:15.605169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee58730-33ed-4873-b7fc-dccafc91e419 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:15.606921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 70/143] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:15.613909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1ad02-cac3-471f-a529-a9eceb3b9395 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.623217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1ad02-cac3-471f-a529-a9eceb3b9395 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.628278 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c614e6-a023-4fcd-8bfb-10f3b2abaa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.628922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c614e6-a023-4fcd-8bfb-10f3b2abaa6e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.629253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c614e6-a023-4fcd-8bfb-10f3b2abaa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.629529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c614e6-a023-4fcd-8bfb-10f3b2abaa6e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.630416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c614e6-a023-4fcd-8bfb-10f3b2abaa6e admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=4b30188d19194873aed7f02c87d439bb, user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:15.630758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c614e6-a023-4fcd-8bfb-10f3b2abaa6e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:15.632755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c614e6-a023-4fcd-8bfb-10f3b2abaa6e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:15.639490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 74/144] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/role_assignments?user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:15.764473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17379227-7326-42b8-a539-412db8bccf7d None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.764473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17379227-7326-42b8-a539-412db8bccf7d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.764473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17379227-7326-42b8-a539-412db8bccf7d None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.764473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 71/145] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:15.771786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f721a-df80-4364-abba-872dba346336 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.772142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f721a-df80-4364-abba-872dba346336 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.772379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f721a-df80-4364-abba-872dba346336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.807568 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-462f721a-df80-4364-abba-872dba346336 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:15.808762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-462f721a-df80-4364-abba-872dba346336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:15.820427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 75/146] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:15.865826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17379227-7326-42b8-a539-412db8bccf7d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.878465 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17379227-7326-42b8-a539-412db8bccf7d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.887674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2c578-1934-4efc-815a-1bb824b36feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.888850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2c578-1934-4efc-815a-1bb824b36feb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.889346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2c578-1934-4efc-815a-1bb824b36feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.889821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2c578-1934-4efc-815a-1bb824b36feb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.907285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2c578-1934-4efc-815a-1bb824b36feb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:15.914963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-1bb2c578-1934-4efc-815a-1bb824b36feb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:15.916530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 72/147] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:15.923273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f721a-df80-4364-abba-872dba346336 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.935648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f721a-df80-4364-abba-872dba346336 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.946316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.947088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.947366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.947641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.948501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:15.948806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:15.950424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:15.964645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 76/148] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:15.971349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2c578-1934-4efc-815a-1bb824b36feb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:15.988593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2c578-1934-4efc-815a-1bb824b36feb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:15.993804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1941-02c4-4147-a332-d6a1acade25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:15.995095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1941-02c4-4147-a332-d6a1acade25f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:15.995595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1941-02c4-4147-a332-d6a1acade25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:15.996060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1941-02c4-4147-a332-d6a1acade25f admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:15.997581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f1941-02c4-4147-a332-d6a1acade25f admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.000087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f1941-02c4-4147-a332-d6a1acade25f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.002063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 73/149] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:15 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:16.008562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.020408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dd926-30b3-4b0c-a8ca-0e44f5f83b0c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.031221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0721c0f-074f-4660-af90-454af60d06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.031932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721c0f-074f-4660-af90-454af60d06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.032218 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721c0f-074f-4660-af90-454af60d06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.032547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721c0f-074f-4660-af90-454af60d06f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.047230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0721c0f-074f-4660-af90-454af60d06f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.049114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0721c0f-074f-4660-af90-454af60d06f8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.063633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 77/150] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:16.070002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1941-02c4-4147-a332-d6a1acade25f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.084948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1941-02c4-4147-a332-d6a1acade25f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.090141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038b66-8373-4c25-89f2-2f4eb30fbb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.091458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038b66-8373-4c25-89f2-2f4eb30fbb48 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.091989 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038b66-8373-4c25-89f2-2f4eb30fbb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.092468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038b66-8373-4c25-89f2-2f4eb30fbb48 admin admin] PATH_INFO: `/v3/projects/228f82a87402494091419a53baea360a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.093932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47038b66-8373-4c25-89f2-2f4eb30fbb48 admin admin] RBAC: Authorizing `identity:get_project(project_id=228f82a87402494091419a53baea360a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.096821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47038b66-8373-4c25-89f2-2f4eb30fbb48 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.098896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 74/151] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/projects/228f82a87402494091419a53baea360a => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:16.106875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0721c0f-074f-4660-af90-454af60d06f8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.116882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0721c0f-074f-4660-af90-454af60d06f8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.127027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8202c3f-7a58-4d33-8ad1-235bf8394ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.127761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202c3f-7a58-4d33-8ad1-235bf8394ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.128040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202c3f-7a58-4d33-8ad1-235bf8394ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.128336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202c3f-7a58-4d33-8ad1-235bf8394ff3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.129685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8202c3f-7a58-4d33-8ad1-235bf8394ff3 admin admin] RBAC: Adding query filter params (role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=228f82a87402494091419a53baea360a, user.id=586f2ce919e340b9a2c07caa44e20460) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:16.130003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8202c3f-7a58-4d33-8ad1-235bf8394ff3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.132084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8202c3f-7a58-4d33-8ad1-235bf8394ff3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.142062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 78/152] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/role_assignments?user.id=586f2ce919e340b9a2c07caa44e20460&scope.project.id=228f82a87402494091419a53baea360a&role.id=185d4a889ab64e4d84c11737116af86a => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:16.589574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838fd0-3739-49df-be8a-77ae99c0da8c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.590616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838fd0-3739-49df-be8a-77ae99c0da8c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.591167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838fd0-3739-49df-be8a-77ae99c0da8c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.593299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 75/153] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:16.600151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416892ba-6ddc-4a54-ba56-8331aa548f04 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.601076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416892ba-6ddc-4a54-ba56-8331aa548f04 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.601546 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416892ba-6ddc-4a54-ba56-8331aa548f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.629286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-416892ba-6ddc-4a54-ba56-8331aa548f04 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:16.631113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-416892ba-6ddc-4a54-ba56-8331aa548f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:16.646297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 79/154] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:16.685632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838fd0-3739-49df-be8a-77ae99c0da8c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.700193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838fd0-3739-49df-be8a-77ae99c0da8c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.710226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45093280-5b4d-4b4c-a7b4-247b5b5a0905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.711357 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45093280-5b4d-4b4c-a7b4-247b5b5a0905 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.711841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45093280-5b4d-4b4c-a7b4-247b5b5a0905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.712303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45093280-5b4d-4b4c-a7b4-247b5b5a0905 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.723467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45093280-5b4d-4b4c-a7b4-247b5b5a0905 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:16.731172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-45093280-5b4d-4b4c-a7b4-247b5b5a0905 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:16.732580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 76/155] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:16.739896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416892ba-6ddc-4a54-ba56-8331aa548f04 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.748949 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416892ba-6ddc-4a54-ba56-8331aa548f04 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.754078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.755024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.755505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.755973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.756958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:16.757452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.759399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.769695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 80/156] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:16.775621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45093280-5b4d-4b4c-a7b4-247b5b5a0905 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.787152 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45093280-5b4d-4b4c-a7b4-247b5b5a0905 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.791963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c64db-0904-451d-8887-9df6b1bfc4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.793066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c64db-0904-451d-8887-9df6b1bfc4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.793552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c64db-0904-451d-8887-9df6b1bfc4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.794010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c64db-0904-451d-8887-9df6b1bfc4f6 admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.795421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c64db-0904-451d-8887-9df6b1bfc4f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.797735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c64db-0904-451d-8887-9df6b1bfc4f6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.800243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 77/157] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:16.806499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.819939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616deb8-6688-476a-a6a0-c9f7c9a0399c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.824596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d7db3-8bb4-4d48-9559-818f14e593bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.825454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7db3-8bb4-4d48-9559-818f14e593bd admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.826038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7db3-8bb4-4d48-9559-818f14e593bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.826502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7db3-8bb4-4d48-9559-818f14e593bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.838038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d7db3-8bb4-4d48-9559-818f14e593bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.840189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d7db3-8bb4-4d48-9559-818f14e593bd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.851808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 81/158] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:16.858165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c64db-0904-451d-8887-9df6b1bfc4f6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.868910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c64db-0904-451d-8887-9df6b1bfc4f6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.878145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c843cf-8958-4ac7-ba3e-2665b9b4b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.879305 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c843cf-8958-4ac7-ba3e-2665b9b4b560 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.879778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c843cf-8958-4ac7-ba3e-2665b9b4b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.880257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c843cf-8958-4ac7-ba3e-2665b9b4b560 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.881623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c843cf-8958-4ac7-ba3e-2665b9b4b560 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.883902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c843cf-8958-4ac7-ba3e-2665b9b4b560 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.885750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 78/159] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:16.892339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d7db3-8bb4-4d48-9559-818f14e593bd admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:16.902625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d7db3-8bb4-4d48-9559-818f14e593bd admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:16.907962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2aa1a-3f19-4b2b-8879-a70ed6804c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:16.909663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2aa1a-3f19-4b2b-8879-a70ed6804c60 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.910135 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2aa1a-3f19-4b2b-8879-a70ed6804c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.910666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2aa1a-3f19-4b2b-8879-a70ed6804c60 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.911689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2aa1a-3f19-4b2b-8879-a70ed6804c60 admin admin] RBAC: Adding query filter params (role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=4b30188d19194873aed7f02c87d439bb, user.id=586f2ce919e340b9a2c07caa44e20460) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:16.912188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2aa1a-3f19-4b2b-8879-a70ed6804c60 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:16.914226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2aa1a-3f19-4b2b-8879-a70ed6804c60 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:16.925210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 82/160] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:16 2021] GET /identity/v3/role_assignments?user.id=586f2ce919e340b9a2c07caa44e20460&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:16.932526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629f0a-0731-4ec1-8641-a8e22b02bfe8 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.932829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629f0a-0731-4ec1-8641-a8e22b02bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.933075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629f0a-0731-4ec1-8641-a8e22b02bfe8 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.935119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 79/161] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:16.942054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b58fb-b07c-425d-b63a-346d7ae046d2 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:16.942620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b58fb-b07c-425d-b63a-346d7ae046d2 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:16.943091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b58fb-b07c-425d-b63a-346d7ae046d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:16.961842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7c6b58fb-b07c-425d-b63a-346d7ae046d2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:16.963368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7c6b58fb-b07c-425d-b63a-346d7ae046d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:16.975845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 83/162] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:17.008958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629f0a-0731-4ec1-8641-a8e22b02bfe8 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.022263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629f0a-0731-4ec1-8641-a8e22b02bfe8 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.027079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22d04-13d2-4197-852d-71cf4a7ff250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.028019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22d04-13d2-4197-852d-71cf4a7ff250 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.028365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22d04-13d2-4197-852d-71cf4a7ff250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.028742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee22d04-13d2-4197-852d-71cf4a7ff250 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.041362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee22d04-13d2-4197-852d-71cf4a7ff250 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:17.049262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-7ee22d04-13d2-4197-852d-71cf4a7ff250 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:17.051243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 80/163] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:17.057770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b58fb-b07c-425d-b63a-346d7ae046d2 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.067468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b58fb-b07c-425d-b63a-346d7ae046d2 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.078874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.079646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.080027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.080369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.081209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:17.081574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.083317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.097878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 84/164] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.104747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22d04-13d2-4197-852d-71cf4a7ff250 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.123549 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee22d04-13d2-4197-852d-71cf4a7ff250 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.128721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c2409-e306-49e1-9e0d-15350a0ba9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.129920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2409-e306-49e1-9e0d-15350a0ba9af admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.130414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2409-e306-49e1-9e0d-15350a0ba9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.130875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c2409-e306-49e1-9e0d-15350a0ba9af admin admin] PATH_INFO: `/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.147349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c2409-e306-49e1-9e0d-15350a0ba9af admin admin] RBAC: Authorizing `identity:get_user(user_id=46d57aabf3dc4fcf84eaa3fa986b6462)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.149815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c2409-e306-49e1-9e0d-15350a0ba9af admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.151842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 81/165] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462 => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.158938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.168791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1a1ed-ce4b-432c-940e-fd67f7889ca7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.173475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e34e-1a81-4df3-bef2-b2e1cecd270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.174838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e34e-1a81-4df3-bef2-b2e1cecd270f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.175265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e34e-1a81-4df3-bef2-b2e1cecd270f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.175599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e34e-1a81-4df3-bef2-b2e1cecd270f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.189467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e34e-1a81-4df3-bef2-b2e1cecd270f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.190684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e34e-1a81-4df3-bef2-b2e1cecd270f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.200875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 85/166] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:17.207011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c2409-e306-49e1-9e0d-15350a0ba9af admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.217943 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c2409-e306-49e1-9e0d-15350a0ba9af admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.224117 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bb420-62be-41bd-8dc7-b045aad09497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.225025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bb420-62be-41bd-8dc7-b045aad09497 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.225355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bb420-62be-41bd-8dc7-b045aad09497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.225627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bb420-62be-41bd-8dc7-b045aad09497 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.226978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bb420-62be-41bd-8dc7-b045aad09497 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.229145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bb420-62be-41bd-8dc7-b045aad09497 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.230881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 82/167] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.237946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e34e-1a81-4df3-bef2-b2e1cecd270f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.247379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e34e-1a81-4df3-bef2-b2e1cecd270f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.254231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2de5e-c1bf-4659-ab11-6afa75b29edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.254972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2de5e-c1bf-4659-ab11-6afa75b29edd admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.255255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2de5e-c1bf-4659-ab11-6afa75b29edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.255521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2de5e-c1bf-4659-ab11-6afa75b29edd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.256519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2de5e-c1bf-4659-ab11-6afa75b29edd admin admin] RBAC: Adding query filter params (role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5, user.id=46d57aabf3dc4fcf84eaa3fa986b6462) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:17.256865 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2de5e-c1bf-4659-ab11-6afa75b29edd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.258855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2de5e-c1bf-4659-ab11-6afa75b29edd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.264985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/role_assignments?user.id=46d57aabf3dc4fcf84eaa3fa986b6462&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=185d4a889ab64e4d84c11737116af86a => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.481054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b23a-cdc7-44f0-adbc-1617330a66ec None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.481387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b23a-cdc7-44f0-adbc-1617330a66ec None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.481557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b23a-cdc7-44f0-adbc-1617330a66ec None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.483357 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 83/169] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:17.490792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48458b-18e8-4dfb-8f0c-9148f829892f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.491359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48458b-18e8-4dfb-8f0c-9148f829892f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.491844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48458b-18e8-4dfb-8f0c-9148f829892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.516659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-2f48458b-18e8-4dfb-8f0c-9148f829892f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:17.518221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2f48458b-18e8-4dfb-8f0c-9148f829892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:17.526397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 87/170] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:17.555807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b23a-cdc7-44f0-adbc-1617330a66ec None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.572372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b23a-cdc7-44f0-adbc-1617330a66ec None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.578887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d81651-a1f5-4ad9-bcf3-b69c7caf2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.579984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81651-a1f5-4ad9-bcf3-b69c7caf2f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.580490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81651-a1f5-4ad9-bcf3-b69c7caf2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.580975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81651-a1f5-4ad9-bcf3-b69c7caf2f99 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.592145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d81651-a1f5-4ad9-bcf3-b69c7caf2f99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:17.600508 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-95d81651-a1f5-4ad9-bcf3-b69c7caf2f99 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:17.601935 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 84/171] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:17.608441 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48458b-18e8-4dfb-8f0c-9148f829892f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.619054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48458b-18e8-4dfb-8f0c-9148f829892f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.623927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.624855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.625368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.625836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.627061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:17.627601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.629511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.638634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 88/172] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.646272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d81651-a1f5-4ad9-bcf3-b69c7caf2f99 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.655573 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d81651-a1f5-4ad9-bcf3-b69c7caf2f99 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.661008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2d34c-b2f9-4c7a-9920-38a951ee98d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.661869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2d34c-b2f9-4c7a-9920-38a951ee98d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.662147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2d34c-b2f9-4c7a-9920-38a951ee98d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.662412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2d34c-b2f9-4c7a-9920-38a951ee98d1 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.667239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2d34c-b2f9-4c7a-9920-38a951ee98d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.669061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2d34c-b2f9-4c7a-9920-38a951ee98d1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.670695 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 85/173] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.677555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.688406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58f26-032e-4fe0-96dc-5f0cea21614f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.693632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3745bc-fad4-4814-b7cd-dbe02d479c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.694651 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3745bc-fad4-4814-b7cd-dbe02d479c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.695213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3745bc-fad4-4814-b7cd-dbe02d479c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.695654 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3745bc-fad4-4814-b7cd-dbe02d479c51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.706149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3745bc-fad4-4814-b7cd-dbe02d479c51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.708320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3745bc-fad4-4814-b7cd-dbe02d479c51 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.718414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 89/174] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:17.725510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2d34c-b2f9-4c7a-9920-38a951ee98d1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.736456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2d34c-b2f9-4c7a-9920-38a951ee98d1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.741654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1419a9-b9da-41fc-bd54-3a5ee75b0fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.742908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1419a9-b9da-41fc-bd54-3a5ee75b0fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.743370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1419a9-b9da-41fc-bd54-3a5ee75b0fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.743867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1419a9-b9da-41fc-bd54-3a5ee75b0fc5 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.745448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1419a9-b9da-41fc-bd54-3a5ee75b0fc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.747942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1419a9-b9da-41fc-bd54-3a5ee75b0fc5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.749981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 86/175] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.756970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3745bc-fad4-4814-b7cd-dbe02d479c51 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.766953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3745bc-fad4-4814-b7cd-dbe02d479c51 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.772479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6536e-5e49-490a-8ee3-37a16028ab91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.773429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6536e-5e49-490a-8ee3-37a16028ab91 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.773928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6536e-5e49-490a-8ee3-37a16028ab91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.774368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6536e-5e49-490a-8ee3-37a16028ab91 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.775494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6536e-5e49-490a-8ee3-37a16028ab91 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5, user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:17.775974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6536e-5e49-490a-8ee3-37a16028ab91 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.778037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6536e-5e49-490a-8ee3-37a16028ab91 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.785044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 90/176] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/role_assignments?user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.843504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8492-701d-451d-afc0-560ae277309a None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.843791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8492-701d-451d-afc0-560ae277309a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.844070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e8492-701d-451d-afc0-560ae277309a None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.846460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 87/177] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:17.853180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f37a-fa7a-412b-af18-c04fe09a0ba5 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.853573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f37a-fa7a-412b-af18-c04fe09a0ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.853926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8f37a-fa7a-412b-af18-c04fe09a0ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.873761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5fc8f37a-fa7a-412b-af18-c04fe09a0ba5 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:17.875012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5fc8f37a-fa7a-412b-af18-c04fe09a0ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:17.883498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 91/178] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:17.900230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba76cd6-e5bb-4111-b914-40b663ce29e4 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.900511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba76cd6-e5bb-4111-b914-40b663ce29e4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.900787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba76cd6-e5bb-4111-b914-40b663ce29e4 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.902677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 88/179] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:55:17.909692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176e35e-97fc-47a0-9201-c62ac570db80 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.909970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176e35e-97fc-47a0-9201-c62ac570db80 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.910239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176e35e-97fc-47a0-9201-c62ac570db80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.918859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba76cd6-e5bb-4111-b914-40b663ce29e4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.931077 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1176e35e-97fc-47a0-9201-c62ac570db80 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:17.932331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1176e35e-97fc-47a0-9201-c62ac570db80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:17.932674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba76cd6-e5bb-4111-b914-40b663ce29e4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.936971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4f470-7591-4436-a617-44ac6521b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.937769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4f470-7591-4436-a617-44ac6521b6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.938047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4f470-7591-4436-a617-44ac6521b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.938319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4f470-7591-4436-a617-44ac6521b6fa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.939582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4f470-7591-4436-a617-44ac6521b6fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.940794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 92/180] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:17.941394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4f470-7591-4436-a617-44ac6521b6fa admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.948384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 89/181] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:17.949832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176e35e-97fc-47a0-9201-c62ac570db80 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.960070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176e35e-97fc-47a0-9201-c62ac570db80 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.964717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c7d25-835d-4490-8096-a3e6dbead764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.965398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c7d25-835d-4490-8096-a3e6dbead764 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.965717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c7d25-835d-4490-8096-a3e6dbead764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.966037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c7d25-835d-4490-8096-a3e6dbead764 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:17.966910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c7d25-835d-4490-8096-a3e6dbead764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:17.968934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c7d25-835d-4490-8096-a3e6dbead764 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:17.972349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4f470-7591-4436-a617-44ac6521b6fa admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:17.984223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4f470-7591-4436-a617-44ac6521b6fa admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:17.989788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5d45-0ab0-405b-b8ed-3ed9222a6bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:17.990621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5d45-0ab0-405b-b8ed-3ed9222a6bdc admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:17.990967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5d45-0ab0-405b-b8ed-3ed9222a6bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:17.991313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5d45-0ab0-405b-b8ed-3ed9222a6bdc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:18.002238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de5d45-0ab0-405b-b8ed-3ed9222a6bdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:18.009788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-f2de5d45-0ab0-405b-b8ed-3ed9222a6bdc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:18.011164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 90/182] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:18.017413 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5d45-0ab0-405b-b8ed-3ed9222a6bdc admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:18.027877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5d45-0ab0-405b-b8ed-3ed9222a6bdc admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:18.032497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:18.033140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:18.033942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:18.039941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:18.039941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:18.039941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:18.039941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:18.046727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 91/183] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:18.052535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:18.063310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb751-8208-4685-9a45-b49824cd926a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:18.066922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 93/184] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:17 2021] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:55:18.073604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d8ca4-32b7-45dd-a5ab-90e2f68257d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:18.074617 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d8ca4-32b7-45dd-a5ab-90e2f68257d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:18.074948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d8ca4-32b7-45dd-a5ab-90e2f68257d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:18.075218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d8ca4-32b7-45dd-a5ab-90e2f68257d7 admin admin] PATH_INFO: `/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:18.076545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d8ca4-32b7-45dd-a5ab-90e2f68257d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=46d57aabf3dc4fcf84eaa3fa986b6462)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:18.079087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d8ca4-32b7-45dd-a5ab-90e2f68257d7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:18.080899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 92/185] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:18 2021] GET /identity/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462 => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:18.088041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c7d25-835d-4490-8096-a3e6dbead764 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:18.100187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c7d25-835d-4490-8096-a3e6dbead764 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:18.105642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa413fe-b6b2-4fcd-b4a8-d42bb8c75943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:18.106750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa413fe-b6b2-4fcd-b4a8-d42bb8c75943 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:18.107240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa413fe-b6b2-4fcd-b4a8-d42bb8c75943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:18.107779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa413fe-b6b2-4fcd-b4a8-d42bb8c75943 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:18.118644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa413fe-b6b2-4fcd-b4a8-d42bb8c75943 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:18.120863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa413fe-b6b2-4fcd-b4a8-d42bb8c75943 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:18.131506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 94/186] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:18.138692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d8ca4-32b7-45dd-a5ab-90e2f68257d7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:18.149638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d8ca4-32b7-45dd-a5ab-90e2f68257d7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:18.155067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b09fc2-9822-4b25-b84a-ecdb23c9d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:18.156342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b09fc2-9822-4b25-b84a-ecdb23c9d450 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:18.156944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b09fc2-9822-4b25-b84a-ecdb23c9d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:18.157470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b09fc2-9822-4b25-b84a-ecdb23c9d450 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:18.159643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b09fc2-9822-4b25-b84a-ecdb23c9d450 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:18.162755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b09fc2-9822-4b25-b84a-ecdb23c9d450 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:18.164869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 93/187] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:18 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:18.172080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa413fe-b6b2-4fcd-b4a8-d42bb8c75943 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:18.182781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa413fe-b6b2-4fcd-b4a8-d42bb8c75943 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:18.187923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd55ff-3fe6-4052-9f76-81abb53e87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:18.188939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd55ff-3fe6-4052-9f76-81abb53e87a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:18.189486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd55ff-3fe6-4052-9f76-81abb53e87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:18.189982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd55ff-3fe6-4052-9f76-81abb53e87a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:18.191141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd55ff-3fe6-4052-9f76-81abb53e87a3 admin admin] RBAC: Adding query filter params (role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5, user.id=46d57aabf3dc4fcf84eaa3fa986b6462) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:18.191657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd55ff-3fe6-4052-9f76-81abb53e87a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:18.193877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd55ff-3fe6-4052-9f76-81abb53e87a3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:18.200630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 95/188] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:18 2021] GET /identity/v3/role_assignments?user.id=46d57aabf3dc4fcf84eaa3fa986b6462&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:19.912438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b33bfc-ba30-4739-8a46-fb4ef7125939 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:19.913446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b33bfc-ba30-4739-8a46-fb4ef7125939 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:19.913931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b33bfc-ba30-4739-8a46-fb4ef7125939 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:19.916265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 94/189] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:19.929128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e627ec2-995d-4570-bace-17d3d18be279 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:19.930009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e627ec2-995d-4570-bace-17d3d18be279 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:19.930484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e627ec2-995d-4570-bace-17d3d18be279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:19.949252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6e627ec2-995d-4570-bace-17d3d18be279 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:19.955076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6e627ec2-995d-4570-bace-17d3d18be279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:19.965098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 96/190] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:20.002996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b33bfc-ba30-4739-8a46-fb4ef7125939 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.019183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b33bfc-ba30-4739-8a46-fb4ef7125939 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.024010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d4d6d-cc3c-4f05-a97d-93502b44bb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.025043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d4d6d-cc3c-4f05-a97d-93502b44bb0b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.025522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d4d6d-cc3c-4f05-a97d-93502b44bb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.026019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d4d6d-cc3c-4f05-a97d-93502b44bb0b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.043585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d4d6d-cc3c-4f05-a97d-93502b44bb0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:20.051987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-f46d4d6d-cc3c-4f05-a97d-93502b44bb0b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:20.059742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e627ec2-995d-4570-bace-17d3d18be279 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.069094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e627ec2-995d-4570-bace-17d3d18be279 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.069354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 95/191] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:20.078581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.079521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.080001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.081010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.081974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:20.082527 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:20.084359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:20.094128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 97/192] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:20.101981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d4d6d-cc3c-4f05-a97d-93502b44bb0b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.112923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d4d6d-cc3c-4f05-a97d-93502b44bb0b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.123277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc11bcd-df1d-40e4-af9d-735be7eef251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.124376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11bcd-df1d-40e4-af9d-735be7eef251 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.124854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11bcd-df1d-40e4-af9d-735be7eef251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.125340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11bcd-df1d-40e4-af9d-735be7eef251 admin admin] PATH_INFO: `/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.131260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc11bcd-df1d-40e4-af9d-735be7eef251 admin admin] RBAC: Authorizing `identity:get_user(user_id=46d57aabf3dc4fcf84eaa3fa986b6462)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:20.133585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc11bcd-df1d-40e4-af9d-735be7eef251 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:20.135398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 96/193] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:20 2021] GET /identity/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:20.141458 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.152297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fec7c-b56f-432a-871a-32b0f887833e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.163575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fba98-f122-4c7a-8b4e-223749313d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.164697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fba98-f122-4c7a-8b4e-223749313d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.165178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fba98-f122-4c7a-8b4e-223749313d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.165663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fba98-f122-4c7a-8b4e-223749313d9c admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.167096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fba98-f122-4c7a-8b4e-223749313d9c admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:20.169357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fba98-f122-4c7a-8b4e-223749313d9c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:20.171276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 98/194] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:20 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:20.177753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc11bcd-df1d-40e4-af9d-735be7eef251 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.188027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc11bcd-df1d-40e4-af9d-735be7eef251 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.198222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d002ff-5944-4b52-8f0a-56194eaa00d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.199462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d002ff-5944-4b52-8f0a-56194eaa00d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.199986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d002ff-5944-4b52-8f0a-56194eaa00d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.200457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d002ff-5944-4b52-8f0a-56194eaa00d1 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/users/46d57aabf3dc4fcf84eaa3fa986b6462/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.207118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d002ff-5944-4b52-8f0a-56194eaa00d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4565572e31b4ffe8a733d9183cd77c5, user_id=46d57aabf3dc4fcf84eaa3fa986b6462, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:20.209995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d002ff-5944-4b52-8f0a-56194eaa00d1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:20.298853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 97/195] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:20 2021] PUT /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/users/46d57aabf3dc4fcf84eaa3fa986b6462/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:20.440901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655934-53bc-45cd-8aa6-533af0dc676c None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.441233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655934-53bc-45cd-8aa6-533af0dc676c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.441351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63655934-53bc-45cd-8aa6-533af0dc676c None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.443346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 99/196] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:20.460153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ccd91-e624-4546-b220-2dbedaecf174 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.460460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ccd91-e624-4546-b220-2dbedaecf174 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.460706 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ccd91-e624-4546-b220-2dbedaecf174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.488469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-d79ccd91-e624-4546-b220-2dbedaecf174 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:20.489702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d79ccd91-e624-4546-b220-2dbedaecf174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:20.561143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 98/197] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:20.600847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63655934-53bc-45cd-8aa6-533af0dc676c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.620277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63655934-53bc-45cd-8aa6-533af0dc676c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.627507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec638a-49c1-4f67-8831-e0619a0a7fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.628322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec638a-49c1-4f67-8831-e0619a0a7fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.628601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec638a-49c1-4f67-8831-e0619a0a7fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.628876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec638a-49c1-4f67-8831-e0619a0a7fc2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.644317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec638a-49c1-4f67-8831-e0619a0a7fc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:20.651395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c8ec638a-49c1-4f67-8831-e0619a0a7fc2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:20.652941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 100/198] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:20.659951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ccd91-e624-4546-b220-2dbedaecf174 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.672996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ccd91-e624-4546-b220-2dbedaecf174 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.679171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.680157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.680637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.681105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.682074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:20.682692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:20.684498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:20.693852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 99/199] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:20.701267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec638a-49c1-4f67-8831-e0619a0a7fc2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.715592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec638a-49c1-4f67-8831-e0619a0a7fc2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.726240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db5dfb-1eac-448d-b9b2-e42b2dbdb8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.727159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db5dfb-1eac-448d-b9b2-e42b2dbdb8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.727442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db5dfb-1eac-448d-b9b2-e42b2dbdb8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.727716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db5dfb-1eac-448d-b9b2-e42b2dbdb8f9 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.731274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db5dfb-1eac-448d-b9b2-e42b2dbdb8f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:20.733093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db5dfb-1eac-448d-b9b2-e42b2dbdb8f9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:20.734726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 101/200] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:20 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:20.741056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.751381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9170d-e2da-4214-a463-6b9ed08d1e4e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.762025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c1fd-5692-4c41-9e11-52b0da0b97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.763335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c1fd-5692-4c41-9e11-52b0da0b97ab admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.763845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c1fd-5692-4c41-9e11-52b0da0b97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.764323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c1fd-5692-4c41-9e11-52b0da0b97ab admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.769670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355c1fd-5692-4c41-9e11-52b0da0b97ab admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:20.772212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355c1fd-5692-4c41-9e11-52b0da0b97ab admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:20.774417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 100/201] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:20 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:20.780999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db5dfb-1eac-448d-b9b2-e42b2dbdb8f9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:20.796322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db5dfb-1eac-448d-b9b2-e42b2dbdb8f9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:20.805516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aff491-26cd-43c8-8d8e-0f540279fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:20.806412 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff491-26cd-43c8-8d8e-0f540279fc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.806754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff491-26cd-43c8-8d8e-0f540279fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.807033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff491-26cd-43c8-8d8e-0f540279fc4c admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.811869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aff491-26cd-43c8-8d8e-0f540279fc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4565572e31b4ffe8a733d9183cd77c5, user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:20.814604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aff491-26cd-43c8-8d8e-0f540279fc4c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:20.896506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 102/202] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:20 2021] PUT /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:20.931023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab43c8-db92-4d19-ac68-50142d89d59c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.931982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab43c8-db92-4d19-ac68-50142d89d59c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.932460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab43c8-db92-4d19-ac68-50142d89d59c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.934953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 101/203] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:20.941953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48c68-e045-49f6-88d5-fdfbaf1b380a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:20.943055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48c68-e045-49f6-88d5-fdfbaf1b380a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:20.943538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48c68-e045-49f6-88d5-fdfbaf1b380a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:20.968232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9ca48c68-e045-49f6-88d5-fdfbaf1b380a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:20.969804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9ca48c68-e045-49f6-88d5-fdfbaf1b380a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:21.048682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 103/204] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:21.092141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab43c8-db92-4d19-ac68-50142d89d59c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.111489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab43c8-db92-4d19-ac68-50142d89d59c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.116939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae93e-8128-4936-a48d-ae6b6ef8913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.118097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae93e-8128-4936-a48d-ae6b6ef8913b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.118605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae93e-8128-4936-a48d-ae6b6ef8913b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.119100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae93e-8128-4936-a48d-ae6b6ef8913b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.134984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ae93e-8128-4936-a48d-ae6b6ef8913b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:21.142283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-8f8ae93e-8128-4936-a48d-ae6b6ef8913b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:21.144364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 102/205] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:21.150800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48c68-e045-49f6-88d5-fdfbaf1b380a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.152902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fcca-a9f4-4343-bf0f-9129439b1048 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.153188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fcca-a9f4-4343-bf0f-9129439b1048 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.153461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fcca-a9f4-4343-bf0f-9129439b1048 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.155599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 103/206] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:55:21.165472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48c68-e045-49f6-88d5-fdfbaf1b380a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.166104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc61df-fbbf-472e-9dc9-e7e3fa8dee1a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.166390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc61df-fbbf-472e-9dc9-e7e3fa8dee1a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.166711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc61df-fbbf-472e-9dc9-e7e3fa8dee1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.176276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.177255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.177734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.178224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.179227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:21.179734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.181965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.188732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e3fc61df-fbbf-472e-9dc9-e7e3fa8dee1a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:21.190420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e3fc61df-fbbf-472e-9dc9-e7e3fa8dee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:21.194288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 104/207] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:21.201186 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.204158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 104/208] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:21.225267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c14ba-92d8-4b65-a200-5c4f00002c3d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.229994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc61df-fbbf-472e-9dc9-e7e3fa8dee1a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.237542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8a963-88ac-4103-b05a-cd6c057a9c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.238716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a963-88ac-4103-b05a-cd6c057a9c1a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.238996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a963-88ac-4103-b05a-cd6c057a9c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.239268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a963-88ac-4103-b05a-cd6c057a9c1a admin admin] PATH_INFO: `/v3/users/773d4de2c32b490682b655b0c381bc82` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.240987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc61df-fbbf-472e-9dc9-e7e3fa8dee1a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.246193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14eeeb-d4d0-4bc7-9d59-f3e9dee16529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.247223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14eeeb-d4d0-4bc7-9d59-f3e9dee16529 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.248557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14eeeb-d4d0-4bc7-9d59-f3e9dee16529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.248992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14eeeb-d4d0-4bc7-9d59-f3e9dee16529 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.261566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14eeeb-d4d0-4bc7-9d59-f3e9dee16529 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:21.270366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-4f14eeeb-d4d0-4bc7-9d59-f3e9dee16529 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:21.271764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 105/209] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:21.278067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14eeeb-d4d0-4bc7-9d59-f3e9dee16529 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.278594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8a963-88ac-4103-b05a-cd6c057a9c1a admin admin] RBAC: Authorizing `identity:get_user(user_id=773d4de2c32b490682b655b0c381bc82)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.280748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8a963-88ac-4103-b05a-cd6c057a9c1a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.282456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 105/210] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/users/773d4de2c32b490682b655b0c381bc82 => generated 293 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:21.292827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8a963-88ac-4103-b05a-cd6c057a9c1a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.294273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14eeeb-d4d0-4bc7-9d59-f3e9dee16529 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.300071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871e68-4b91-4955-9cb2-13764593e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.301220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871e68-4b91-4955-9cb2-13764593e2ba admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.302224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871e68-4b91-4955-9cb2-13764593e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.302773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871e68-4b91-4955-9cb2-13764593e2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.304039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3871e68-4b91-4955-9cb2-13764593e2ba admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:21.304491 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3871e68-4b91-4955-9cb2-13764593e2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.305619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8a963-88ac-4103-b05a-cd6c057a9c1a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.306651 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3871e68-4b91-4955-9cb2-13764593e2ba admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.310304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d950b-5963-4d12-bbe2-98357d799993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.311041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d950b-5963-4d12-bbe2-98357d799993 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.311376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d950b-5963-4d12-bbe2-98357d799993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.311652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d950b-5963-4d12-bbe2-98357d799993 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.312549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d950b-5963-4d12-bbe2-98357d799993 admin admin] RBAC: Adding query filter params (role.id=185d4a889ab64e4d84c11737116af86a, user.id=773d4de2c32b490682b655b0c381bc82, scope.system=all) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:21.312859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d950b-5963-4d12-bbe2-98357d799993 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.315488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d950b-5963-4d12-bbe2-98357d799993 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.318709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 106/211] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:21.326644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da6d80-2069-4949-a097-b7b421ac6057 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.326644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da6d80-2069-4949-a097-b7b421ac6057 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.326644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da6d80-2069-4949-a097-b7b421ac6057 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.326644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 107/212] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:21.331311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da6d80-2069-4949-a097-b7b421ac6057 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.333697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 106/213] 10.222.0.16 () {56 vars in 1329 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/role_assignments?user.id=773d4de2c32b490682b655b0c381bc82&scope.system=all&role.id=185d4a889ab64e4d84c11737116af86a => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:21.335396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cbafd-3f71-4b4b-b852-ab5c3097ce47 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.335780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cbafd-3f71-4b4b-b852-ab5c3097ce47 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.336128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cbafd-3f71-4b4b-b852-ab5c3097ce47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.355507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da6d80-2069-4949-a097-b7b421ac6057 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.366339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a52158-0274-4dfc-88bd-8fe7c875d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.368278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a52158-0274-4dfc-88bd-8fe7c875d358 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.369428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a52158-0274-4dfc-88bd-8fe7c875d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.370712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3c6cbafd-3f71-4b4b-b852-ab5c3097ce47 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:21.371291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a52158-0274-4dfc-88bd-8fe7c875d358 admin admin] PATH_INFO: `/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.372793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3c6cbafd-3f71-4b4b-b852-ab5c3097ce47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:21.373812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a52158-0274-4dfc-88bd-8fe7c875d358 admin admin] RBAC: Authorizing `identity:get_user(user_id=46d57aabf3dc4fcf84eaa3fa986b6462)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.376127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a52158-0274-4dfc-88bd-8fe7c875d358 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.382365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 108/214] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462 => generated 283 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:21.388836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a52158-0274-4dfc-88bd-8fe7c875d358 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.394331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 107/215] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:21.408004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a52158-0274-4dfc-88bd-8fe7c875d358 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.418873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba8b48-2343-4f24-a7b0-746881823d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.419777 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba8b48-2343-4f24-a7b0-746881823d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.420109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba8b48-2343-4f24-a7b0-746881823d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.420383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba8b48-2343-4f24-a7b0-746881823d36 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.421736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba8b48-2343-4f24-a7b0-746881823d36 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.424619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba8b48-2343-4f24-a7b0-746881823d36 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.426867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 109/216] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:21.435740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cbafd-3f71-4b4b-b852-ab5c3097ce47 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.454692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cbafd-3f71-4b4b-b852-ab5c3097ce47 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.456716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba8b48-2343-4f24-a7b0-746881823d36 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.459868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b8fe9-3db0-4ff1-b5fb-c4c4fc728ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.461043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8fe9-3db0-4ff1-b5fb-c4c4fc728ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.461542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8fe9-3db0-4ff1-b5fb-c4c4fc728ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.462023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8fe9-3db0-4ff1-b5fb-c4c4fc728ee1 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/users/46d57aabf3dc4fcf84eaa3fa986b6462/roles/c6ba186164fa477bb92f50bf3180c74d` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.464942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b8fe9-3db0-4ff1-b5fb-c4c4fc728ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4565572e31b4ffe8a733d9183cd77c5, user_id=46d57aabf3dc4fcf84eaa3fa986b6462, role_id=c6ba186164fa477bb92f50bf3180c74d)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.467932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba8b48-2343-4f24-a7b0-746881823d36 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.468426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b8fe9-3db0-4ff1-b5fb-c4c4fc728ee1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.473001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2d65d-4a54-4c2c-9905-8f9aaf5c6918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.473447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2d65d-4a54-4c2c-9905-8f9aaf5c6918 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.473733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2d65d-4a54-4c2c-9905-8f9aaf5c6918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.474008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2d65d-4a54-4c2c-9905-8f9aaf5c6918 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.479703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2d65d-4a54-4c2c-9905-8f9aaf5c6918 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.486961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2d65d-4a54-4c2c-9905-8f9aaf5c6918 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.486961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 110/217] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:21.490198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2d65d-4a54-4c2c-9905-8f9aaf5c6918 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:21.500995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2d65d-4a54-4c2c-9905-8f9aaf5c6918 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:21.507358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37077fa0-bf9f-463f-ba41-4ad1afa5ff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:21.508114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37077fa0-bf9f-463f-ba41-4ad1afa5ff0e admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:21.508402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37077fa0-bf9f-463f-ba41-4ad1afa5ff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:21.508773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37077fa0-bf9f-463f-ba41-4ad1afa5ff0e admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:21.509945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37077fa0-bf9f-463f-ba41-4ad1afa5ff0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:21.511760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-37077fa0-bf9f-463f-ba41-4ad1afa5ff0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:21.511760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:21.511760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:21.513096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37077fa0-bf9f-463f-ba41-4ad1afa5ff0e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:21.561881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 108/218] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:21 2021] PUT /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/users/46d57aabf3dc4fcf84eaa3fa986b6462/roles/c6ba186164fa477bb92f50bf3180c74d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:21.645924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 111/219] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:21 2021] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:55:22.990275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d7ec1-7361-45cf-bee6-ab4f27d4f40d None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:22.990852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d7ec1-7361-45cf-bee6-ab4f27d4f40d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:22.990852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d7ec1-7361-45cf-bee6-ab4f27d4f40d None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:22.992732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 109/220] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:23.003908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f307b-9c3a-4cd3-a926-aab594c5755f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:23.004379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f307b-9c3a-4cd3-a926-aab594c5755f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:23.004467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f307b-9c3a-4cd3-a926-aab594c5755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:23.027128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c45f307b-9c3a-4cd3-a926-aab594c5755f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:23.028289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c45f307b-9c3a-4cd3-a926-aab594c5755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:23.099187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 112/221] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:23.139487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d7ec1-7361-45cf-bee6-ab4f27d4f40d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:23.159213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d7ec1-7361-45cf-bee6-ab4f27d4f40d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:23.163969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294af9-67c0-41c8-b629-64f0265fc2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:23.164912 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294af9-67c0-41c8-b629-64f0265fc2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:23.165214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294af9-67c0-41c8-b629-64f0265fc2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:23.165485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294af9-67c0-41c8-b629-64f0265fc2aa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:23.187513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e294af9-67c0-41c8-b629-64f0265fc2aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:23.195199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-0e294af9-67c0-41c8-b629-64f0265fc2aa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:23.196577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 110/222] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:23.203258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f307b-9c3a-4cd3-a926-aab594c5755f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:23.219548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f307b-9c3a-4cd3-a926-aab594c5755f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:23.230213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:23.230914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:23.231197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:23.231474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:23.232247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] RBAC: Adding query filter params (name=member) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:23.232556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:23.234198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:23.251123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 113/223] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:23.257972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294af9-67c0-41c8-b629-64f0265fc2aa admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:23.269106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294af9-67c0-41c8-b629-64f0265fc2aa admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:23.283161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4481f-8d94-4fa3-85be-b5ffadfec474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:23.284054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4481f-8d94-4fa3-85be-b5ffadfec474 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:23.284335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4481f-8d94-4fa3-85be-b5ffadfec474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:23.284604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4481f-8d94-4fa3-85be-b5ffadfec474 admin admin] PATH_INFO: `/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:23.285909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4481f-8d94-4fa3-85be-b5ffadfec474 admin admin] RBAC: Authorizing `identity:get_user(user_id=46d57aabf3dc4fcf84eaa3fa986b6462)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:23.288155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4481f-8d94-4fa3-85be-b5ffadfec474 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:23.289904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 111/224] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:23 2021] GET /identity/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:23.296105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:23.311422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca16aa-a1a8-4377-983e-adef460e79ca admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:23.322173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30728a-0dae-4493-88eb-994679e721eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:23.322839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30728a-0dae-4493-88eb-994679e721eb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:23.323125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30728a-0dae-4493-88eb-994679e721eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:23.323398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30728a-0dae-4493-88eb-994679e721eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:23.334376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30728a-0dae-4493-88eb-994679e721eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:23.336146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30728a-0dae-4493-88eb-994679e721eb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:23.352216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 114/225] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:23.358750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4481f-8d94-4fa3-85be-b5ffadfec474 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:23.371546 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4481f-8d94-4fa3-85be-b5ffadfec474 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:23.379531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9a58f-834b-4e67-89de-6936b45afd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:23.380430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a58f-834b-4e67-89de-6936b45afd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:23.380752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a58f-834b-4e67-89de-6936b45afd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:23.381026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a58f-834b-4e67-89de-6936b45afd2d admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:23.382957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9a58f-834b-4e67-89de-6936b45afd2d admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:23.385072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9a58f-834b-4e67-89de-6936b45afd2d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:23.387101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 112/226] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:23 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:23.393856 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30728a-0dae-4493-88eb-994679e721eb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:23.407496 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30728a-0dae-4493-88eb-994679e721eb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:23.418148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40264f9-2c79-4e8b-87ce-3de7878d444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:23.418815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40264f9-2c79-4e8b-87ce-3de7878d444d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:23.419098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40264f9-2c79-4e8b-87ce-3de7878d444d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:23.419371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40264f9-2c79-4e8b-87ce-3de7878d444d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:23.420206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40264f9-2c79-4e8b-87ce-3de7878d444d admin admin] RBAC: Adding query filter params (role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5, user.id=46d57aabf3dc4fcf84eaa3fa986b6462) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:23.420512 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40264f9-2c79-4e8b-87ce-3de7878d444d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:23.422346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40264f9-2c79-4e8b-87ce-3de7878d444d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:23.431006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 115/227] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:23 2021] GET /identity/v3/role_assignments?user.id=46d57aabf3dc4fcf84eaa3fa986b6462&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=185d4a889ab64e4d84c11737116af86a => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:24.085146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24141b96-7552-4d9f-8bf0-87e8e7f6134b None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.085737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24141b96-7552-4d9f-8bf0-87e8e7f6134b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.085737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24141b96-7552-4d9f-8bf0-87e8e7f6134b None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.087741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 113/228] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:24.100708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5b56-237d-4918-8a61-a2cc22fd5267 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.101197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5b56-237d-4918-8a61-a2cc22fd5267 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.101294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5b56-237d-4918-8a61-a2cc22fd5267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.136891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dc9c5b56-237d-4918-8a61-a2cc22fd5267 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:24.138114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dc9c5b56-237d-4918-8a61-a2cc22fd5267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:24.154418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 116/229] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:24.193955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24141b96-7552-4d9f-8bf0-87e8e7f6134b None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.219240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24141b96-7552-4d9f-8bf0-87e8e7f6134b None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.225308 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e9233-7f4f-4732-942b-6b1721f0612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.226097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e9233-7f4f-4732-942b-6b1721f0612e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.226373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e9233-7f4f-4732-942b-6b1721f0612e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.226665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e9233-7f4f-4732-942b-6b1721f0612e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.242314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e9233-7f4f-4732-942b-6b1721f0612e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:24.249444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-912e9233-7f4f-4732-942b-6b1721f0612e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:24.251483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 114/230] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:24.264458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c5b56-237d-4918-8a61-a2cc22fd5267 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.285612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c5b56-237d-4918-8a61-a2cc22fd5267 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.299263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.299968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.300255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.300536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.301311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:24.301619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:24.303272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:24.314090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 117/231] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:24.320321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e9233-7f4f-4732-942b-6b1721f0612e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.337273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e9233-7f4f-4732-942b-6b1721f0612e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.344053 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113cc57-21d8-41fe-bc3f-74bdc8b9d057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.345106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113cc57-21d8-41fe-bc3f-74bdc8b9d057 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.345456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113cc57-21d8-41fe-bc3f-74bdc8b9d057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.345734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113cc57-21d8-41fe-bc3f-74bdc8b9d057 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.348715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113cc57-21d8-41fe-bc3f-74bdc8b9d057 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:24.350658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113cc57-21d8-41fe-bc3f-74bdc8b9d057 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:24.352801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 115/232] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:24.358667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.371626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e18149-cd63-4203-a1b8-8afbd7a89f92 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.382379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3e66a-d0e8-49ac-9e54-9ec7192eb5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.383061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e66a-d0e8-49ac-9e54-9ec7192eb5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.383341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e66a-d0e8-49ac-9e54-9ec7192eb5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.383615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e66a-d0e8-49ac-9e54-9ec7192eb5c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.399261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3e66a-d0e8-49ac-9e54-9ec7192eb5c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:24.401035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3e66a-d0e8-49ac-9e54-9ec7192eb5c0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:24.412993 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 118/233] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:24.419215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113cc57-21d8-41fe-bc3f-74bdc8b9d057 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.432364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113cc57-21d8-41fe-bc3f-74bdc8b9d057 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.438524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee20aab-01b0-4f15-aa05-9976bc80f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.439468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20aab-01b0-4f15-aa05-9976bc80f5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.439789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20aab-01b0-4f15-aa05-9976bc80f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.440060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20aab-01b0-4f15-aa05-9976bc80f5a2 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.441259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee20aab-01b0-4f15-aa05-9976bc80f5a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:24.443507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee20aab-01b0-4f15-aa05-9976bc80f5a2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:24.445387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 116/234] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:24.451606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3e66a-d0e8-49ac-9e54-9ec7192eb5c0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.461438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3e66a-d0e8-49ac-9e54-9ec7192eb5c0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.468420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da29d95-bdc5-4c7e-bd68-d330760d7e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.469061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29d95-bdc5-4c7e-bd68-d330760d7e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.469336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29d95-bdc5-4c7e-bd68-d330760d7e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.469613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29d95-bdc5-4c7e-bd68-d330760d7e51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.470489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da29d95-bdc5-4c7e-bd68-d330760d7e51 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5, user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:24.470819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da29d95-bdc5-4c7e-bd68-d330760d7e51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:24.473458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da29d95-bdc5-4c7e-bd68-d330760d7e51 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:24.480387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 119/235] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/role_assignments?user.id=2ae4cc8e79cb47cc8c55c2d79c2c09d0&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:24.489040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ba2c2-3fb4-44a9-9f16-deddf5304758 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.489361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ba2c2-3fb4-44a9-9f16-deddf5304758 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.489576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ba2c2-3fb4-44a9-9f16-deddf5304758 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.491788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 117/236] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:24.502281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120e2a-6973-42db-a41b-2f0454d3f8e2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.502281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120e2a-6973-42db-a41b-2f0454d3f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.502281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120e2a-6973-42db-a41b-2f0454d3f8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.528359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-66120e2a-6973-42db-a41b-2f0454d3f8e2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:24.529921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-66120e2a-6973-42db-a41b-2f0454d3f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:24.544976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 120/237] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:24.594033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ba2c2-3fb4-44a9-9f16-deddf5304758 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.615280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ba2c2-3fb4-44a9-9f16-deddf5304758 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.619929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e29f74-984d-4a7e-8476-cec615c76101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.620774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e29f74-984d-4a7e-8476-cec615c76101 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.621051 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e29f74-984d-4a7e-8476-cec615c76101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.621371 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e29f74-984d-4a7e-8476-cec615c76101 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.641122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e29f74-984d-4a7e-8476-cec615c76101 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:24.649202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-95e29f74-984d-4a7e-8476-cec615c76101 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:24.654439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 118/238] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:24.656871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120e2a-6973-42db-a41b-2f0454d3f8e2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.670261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120e2a-6973-42db-a41b-2f0454d3f8e2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.683904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.684956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.685433 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.685898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.686895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:24.687501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:24.689375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:24.706743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 121/239] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:24.714348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e29f74-984d-4a7e-8476-cec615c76101 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.729183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e29f74-984d-4a7e-8476-cec615c76101 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.735407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d1ee9-b5e5-4916-81e7-f3bd57582bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.736365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d1ee9-b5e5-4916-81e7-f3bd57582bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.736770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d1ee9-b5e5-4916-81e7-f3bd57582bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.737055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d1ee9-b5e5-4916-81e7-f3bd57582bb6 admin admin] PATH_INFO: `/v3/users/773d4de2c32b490682b655b0c381bc82` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.739336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d1ee9-b5e5-4916-81e7-f3bd57582bb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=773d4de2c32b490682b655b0c381bc82)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:24.741649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d1ee9-b5e5-4916-81e7-f3bd57582bb6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:24.743709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 119/240] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:24 2021] GET /identity/v3/users/773d4de2c32b490682b655b0c381bc82 => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:24.749598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:24.763339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d8ff9-11cf-45e1-8af5-3f60a99d962a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:24.773195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596adf3-805e-431b-b454-fb691484d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:24.774066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596adf3-805e-431b-b454-fb691484d1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:24.774341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596adf3-805e-431b-b454-fb691484d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:24.774704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596adf3-805e-431b-b454-fb691484d1b2 admin admin] PATH_INFO: `/v3/system/users/773d4de2c32b490682b655b0c381bc82/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:24.776690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596adf3-805e-431b-b454-fb691484d1b2 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=773d4de2c32b490682b655b0c381bc82, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:24.777721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-e596adf3-805e-431b-b454-fb691484d1b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:24.777721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:24.777721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:24.778642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596adf3-805e-431b-b454-fb691484d1b2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:24.888768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 122/241] 10.222.0.16 () {58 vars in 1355 bytes} [Thu Nov 11 16:55:24 2021] PUT /identity/v3/system/users/773d4de2c32b490682b655b0c381bc82/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:25.010330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516325f-2423-4c1e-8206-59a50b21f449 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.010697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516325f-2423-4c1e-8206-59a50b21f449 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.010965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516325f-2423-4c1e-8206-59a50b21f449 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.012789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 120/242] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:25.019300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8131ca5-1975-4544-97c5-9c2634593342 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.019940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8131ca5-1975-4544-97c5-9c2634593342 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.020428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8131ca5-1975-4544-97c5-9c2634593342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.039723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b8131ca5-1975-4544-97c5-9c2634593342 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:25.041281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b8131ca5-1975-4544-97c5-9c2634593342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:25.050102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 123/243] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:25.076983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516325f-2423-4c1e-8206-59a50b21f449 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.091100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516325f-2423-4c1e-8206-59a50b21f449 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.096585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e05620-342d-4d8e-b3a0-3fad4595ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.097756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05620-342d-4d8e-b3a0-3fad4595ba03 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.098291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05620-342d-4d8e-b3a0-3fad4595ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.098868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e05620-342d-4d8e-b3a0-3fad4595ba03 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.110948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e05620-342d-4d8e-b3a0-3fad4595ba03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:25.120309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-33e05620-342d-4d8e-b3a0-3fad4595ba03 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:25.122136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 121/244] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:25.132127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8131ca5-1975-4544-97c5-9c2634593342 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.143011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8131ca5-1975-4544-97c5-9c2634593342 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.148500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.149554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.150080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.150659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.151689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:25.152187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:25.154180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:25.167220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 124/245] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:25.173688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e05620-342d-4d8e-b3a0-3fad4595ba03 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.186057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e05620-342d-4d8e-b3a0-3fad4595ba03 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.191816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087099-efe2-4406-97be-1f83e76e37fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.192887 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087099-efe2-4406-97be-1f83e76e37fb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.193235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087099-efe2-4406-97be-1f83e76e37fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.193549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087099-efe2-4406-97be-1f83e76e37fb admin admin] PATH_INFO: `/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.194868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c087099-efe2-4406-97be-1f83e76e37fb admin admin] RBAC: Authorizing `identity:get_user(user_id=46d57aabf3dc4fcf84eaa3fa986b6462)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:25.197138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c087099-efe2-4406-97be-1f83e76e37fb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:25.198979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 122/246] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:25.205914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.217630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545dcf9-f3ea-456a-a310-27b73c9999ef admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.222877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506ef61-a5b5-498f-99c5-6085d2713686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.223816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ef61-a5b5-498f-99c5-6085d2713686 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.224177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ef61-a5b5-498f-99c5-6085d2713686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.224515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ef61-a5b5-498f-99c5-6085d2713686 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.234694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506ef61-a5b5-498f-99c5-6085d2713686 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:25.236544 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506ef61-a5b5-498f-99c5-6085d2713686 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:25.248308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 125/247] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:25.255314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087099-efe2-4406-97be-1f83e76e37fb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.265839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087099-efe2-4406-97be-1f83e76e37fb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.271072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929c370-3b74-4564-a5ce-be76806cf4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.271998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929c370-3b74-4564-a5ce-be76806cf4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.272320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929c370-3b74-4564-a5ce-be76806cf4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.272631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929c370-3b74-4564-a5ce-be76806cf4f6 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.273956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929c370-3b74-4564-a5ce-be76806cf4f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:25.276264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929c370-3b74-4564-a5ce-be76806cf4f6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:25.278097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 123/248] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:25.285164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506ef61-a5b5-498f-99c5-6085d2713686 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.294666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506ef61-a5b5-498f-99c5-6085d2713686 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.299502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d8ae8-649a-48ae-a8da-27f18b2bd734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.300197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d8ae8-649a-48ae-a8da-27f18b2bd734 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.300477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d8ae8-649a-48ae-a8da-27f18b2bd734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.300755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d8ae8-649a-48ae-a8da-27f18b2bd734 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.301643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d8ae8-649a-48ae-a8da-27f18b2bd734 admin admin] RBAC: Adding query filter params (role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5, user.id=46d57aabf3dc4fcf84eaa3fa986b6462) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:25.302002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d8ae8-649a-48ae-a8da-27f18b2bd734 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:25.303939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d8ae8-649a-48ae-a8da-27f18b2bd734 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:25.311000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 126/249] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/role_assignments?user.id=46d57aabf3dc4fcf84eaa3fa986b6462&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:25.554096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43273705-6225-4c70-997d-f447181052da None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.554440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43273705-6225-4c70-997d-f447181052da None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.554680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43273705-6225-4c70-997d-f447181052da None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.556759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 124/250] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:25.563345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7fbf8-3ffc-4959-80c9-9f62f06dbedd None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.563656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7fbf8-3ffc-4959-80c9-9f62f06dbedd None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.563900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7fbf8-3ffc-4959-80c9-9f62f06dbedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.588239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a0b7fbf8-3ffc-4959-80c9-9f62f06dbedd None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:25.589610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a0b7fbf8-3ffc-4959-80c9-9f62f06dbedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:25.599986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 127/251] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:25.626468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43273705-6225-4c70-997d-f447181052da None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.639265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43273705-6225-4c70-997d-f447181052da None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.644611 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c088d-150b-44f6-8749-3e49a990bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.645436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c088d-150b-44f6-8749-3e49a990bf10 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.645742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c088d-150b-44f6-8749-3e49a990bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.646042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c088d-150b-44f6-8749-3e49a990bf10 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.657848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c088d-150b-44f6-8749-3e49a990bf10 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:25.665630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-443c088d-150b-44f6-8749-3e49a990bf10 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 11 16:55:25.667188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 125/252] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:25.673574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7fbf8-3ffc-4959-80c9-9f62f06dbedd None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.683877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7fbf8-3ffc-4959-80c9-9f62f06dbedd None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.688774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.689688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.690204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.690737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.691716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:25.692217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:25.694027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:25.703453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 128/253] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:25.709722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c088d-150b-44f6-8749-3e49a990bf10 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.719436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c088d-150b-44f6-8749-3e49a990bf10 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.724507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30ee6-0955-40d3-94a1-d2efe39cfe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.725371 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30ee6-0955-40d3-94a1-d2efe39cfe50 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.725655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30ee6-0955-40d3-94a1-d2efe39cfe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.725929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30ee6-0955-40d3-94a1-d2efe39cfe50 admin admin] PATH_INFO: `/v3/users/6d49b59c74bc42d38fb33c02491637da` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.741852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd30ee6-0955-40d3-94a1-d2efe39cfe50 admin admin] RBAC: Authorizing `identity:get_user(user_id=6d49b59c74bc42d38fb33c02491637da)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:25.744111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd30ee6-0955-40d3-94a1-d2efe39cfe50 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:25.746162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 126/254] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/users/6d49b59c74bc42d38fb33c02491637da => generated 293 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:25.753090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:25.765285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461688-04b3-4147-9399-ad189ff384f2 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:25.770816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920496f-86e7-4e30-98a5-66451cadfe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:25.771487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920496f-86e7-4e30-98a5-66451cadfe29 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.771763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920496f-86e7-4e30-98a5-66451cadfe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.772033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920496f-86e7-4e30-98a5-66451cadfe29 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.772878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920496f-86e7-4e30-98a5-66451cadfe29 admin admin] RBAC: Adding query filter params (role.id=4081ecccbbf04f3da4836fa060f64735, user.id=6d49b59c74bc42d38fb33c02491637da, scope.system=all) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:25.773189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920496f-86e7-4e30-98a5-66451cadfe29 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:25.775099 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920496f-86e7-4e30-98a5-66451cadfe29 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:25.782985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 129/255] 10.222.0.16 () {56 vars in 1329 bytes} [Thu Nov 11 16:55:25 2021] GET /identity/v3/role_assignments?user.id=6d49b59c74bc42d38fb33c02491637da&scope.system=all&role.id=4081ecccbbf04f3da4836fa060f64735 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:25.902521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca056-b731-4493-928f-d478fcc83bf0 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.903048 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca056-b731-4493-928f-d478fcc83bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.903372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca056-b731-4493-928f-d478fcc83bf0 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:25.905550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 127/256] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:25.912859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff727d61-e75c-4145-a99c-c9e66f22b504 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:25.913210 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff727d61-e75c-4145-a99c-c9e66f22b504 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:25.913506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff727d61-e75c-4145-a99c-c9e66f22b504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:26.040875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ff727d61-e75c-4145-a99c-c9e66f22b504 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:26.042057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ff727d61-e75c-4145-a99c-c9e66f22b504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:26.049763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 130/257] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:26.072926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca056-b731-4493-928f-d478fcc83bf0 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:26.085437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca056-b731-4493-928f-d478fcc83bf0 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:26.089638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b02906-6f96-4552-9570-a5c44fde2347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:26.090426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02906-6f96-4552-9570-a5c44fde2347 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:26.090775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02906-6f96-4552-9570-a5c44fde2347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:26.091046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b02906-6f96-4552-9570-a5c44fde2347 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:26.092193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b02906-6f96-4552-9570-a5c44fde2347 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:26.093893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b02906-6f96-4552-9570-a5c44fde2347 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:26.096756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 128/258] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:26.104097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff727d61-e75c-4145-a99c-c9e66f22b504 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:26.114200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff727d61-e75c-4145-a99c-c9e66f22b504 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:26.118793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee7b2-9e43-4d11-8ae3-5d9a94cc6794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:26.119458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee7b2-9e43-4d11-8ae3-5d9a94cc6794 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:26.119742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee7b2-9e43-4d11-8ae3-5d9a94cc6794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:26.120019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee7b2-9e43-4d11-8ae3-5d9a94cc6794 admin admin] PATH_INFO: `/v3/groups` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:26.120734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee7b2-9e43-4d11-8ae3-5d9a94cc6794 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:26.121746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-1e5ee7b2-9e43-4d11-8ae3-5d9a94cc6794 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:26.121746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:26.121746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:26.122955 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ee7b2-9e43-4d11-8ae3-5d9a94cc6794 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:26.196659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 131/259] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Nov 11 16:55:26 2021] POST /identity/v3/groups => generated 229 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:55:27.265192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfd92-5091-4d6b-93dc-50869d25c98a None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:27.265727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfd92-5091-4d6b-93dc-50869d25c98a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:27.265727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dfd92-5091-4d6b-93dc-50869d25c98a None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:27.267681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 129/260] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:27.273438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3cdf9-4c58-49cf-b771-083f5b527750 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:27.273945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3cdf9-4c58-49cf-b771-083f5b527750 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:27.274158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3cdf9-4c58-49cf-b771-083f5b527750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:27.292238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-fdd3cdf9-4c58-49cf-b771-083f5b527750 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:27.293468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-fdd3cdf9-4c58-49cf-b771-083f5b527750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:27.301854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 132/261] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:27.333453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dfd92-5091-4d6b-93dc-50869d25c98a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:27.345925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dfd92-5091-4d6b-93dc-50869d25c98a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:27.350535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c775a-7cdc-413d-b2d9-669179d91dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:27.351554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c775a-7cdc-413d-b2d9-669179d91dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:27.352017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c775a-7cdc-413d-b2d9-669179d91dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:27.352499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c775a-7cdc-413d-b2d9-669179d91dbc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:27.363927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c775a-7cdc-413d-b2d9-669179d91dbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:27.371355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-378c775a-7cdc-413d-b2d9-669179d91dbc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:27.372724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 130/262] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:27.379763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3cdf9-4c58-49cf-b771-083f5b527750 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:27.388880 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3cdf9-4c58-49cf-b771-083f5b527750 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:27.393416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:27.394099 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:27.394404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:27.394709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:27.395518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:27.395871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:27.397672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:27.407674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 133/263] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:27.414335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c775a-7cdc-413d-b2d9-669179d91dbc admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:27.531594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c775a-7cdc-413d-b2d9-669179d91dbc admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:27.536400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46877717-86f8-46b1-b282-566f0efc164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:27.537442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46877717-86f8-46b1-b282-566f0efc164e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:27.537900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46877717-86f8-46b1-b282-566f0efc164e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:27.538373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46877717-86f8-46b1-b282-566f0efc164e admin admin] PATH_INFO: `/v3/users/773d4de2c32b490682b655b0c381bc82` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:27.539775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46877717-86f8-46b1-b282-566f0efc164e admin admin] RBAC: Authorizing `identity:get_user(user_id=773d4de2c32b490682b655b0c381bc82)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:27.542055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46877717-86f8-46b1-b282-566f0efc164e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:27.543858 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 131/264] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:27 2021] GET /identity/v3/users/773d4de2c32b490682b655b0c381bc82 => generated 293 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:27.550907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:27.560797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43622ded-abd7-4c42-9f33-967d34ccbc7e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:27.565963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec57dfa-0f66-4873-b676-44c924292b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:27.566811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57dfa-0f66-4873-b676-44c924292b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:27.567238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57dfa-0f66-4873-b676-44c924292b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:27.567656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57dfa-0f66-4873-b676-44c924292b29 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:27.568649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec57dfa-0f66-4873-b676-44c924292b29 admin admin] RBAC: Adding query filter params (role.id=185d4a889ab64e4d84c11737116af86a, user.id=773d4de2c32b490682b655b0c381bc82, scope.system=all) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:27.569104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec57dfa-0f66-4873-b676-44c924292b29 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:27.571141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec57dfa-0f66-4873-b676-44c924292b29 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:27.591422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 134/265] 10.222.0.16 () {56 vars in 1329 bytes} [Thu Nov 11 16:55:27 2021] GET /identity/v3/role_assignments?user.id=773d4de2c32b490682b655b0c381bc82&scope.system=all&role.id=185d4a889ab64e4d84c11737116af86a => generated 510 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:28.084210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a544-054e-43c1-bd49-9886d78532bb None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.084496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a544-054e-43c1-bd49-9886d78532bb None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.084769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0a544-054e-43c1-bd49-9886d78532bb None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.086536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 132/266] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:55:28.092522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5253b1a-8ba0-4b39-8f00-d60e426a7425 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.092809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5253b1a-8ba0-4b39-8f00-d60e426a7425 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.093083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5253b1a-8ba0-4b39-8f00-d60e426a7425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.110949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a5253b1a-8ba0-4b39-8f00-d60e426a7425 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:28.112136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a5253b1a-8ba0-4b39-8f00-d60e426a7425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:28.119712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 135/267] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:28.142012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a544-054e-43c1-bd49-9886d78532bb None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:28.154280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0a544-054e-43c1-bd49-9886d78532bb None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:28.158454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71b543-d7b9-4f13-a44c-c82480150584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:28.159870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71b543-d7b9-4f13-a44c-c82480150584 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.160163 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71b543-d7b9-4f13-a44c-c82480150584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.160443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71b543-d7b9-4f13-a44c-c82480150584 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.170495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71b543-d7b9-4f13-a44c-c82480150584 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:28.178903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-4b71b543-d7b9-4f13-a44c-c82480150584 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 11 16:55:28.180073 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 133/268] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:28 2021] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:28.186456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5253b1a-8ba0-4b39-8f00-d60e426a7425 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:28.195370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5253b1a-8ba0-4b39-8f00-d60e426a7425 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:28.199692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:28.200347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.200626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.200896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.201648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:28.201950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:28.203558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:28.212318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 136/269] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:28 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:28.219752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71b543-d7b9-4f13-a44c-c82480150584 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:28.230288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71b543-d7b9-4f13-a44c-c82480150584 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:28.234458 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394d51b-94ca-40e5-93ef-4749c7e84431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:28.235322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d51b-94ca-40e5-93ef-4749c7e84431 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.235597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d51b-94ca-40e5-93ef-4749c7e84431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.235864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d51b-94ca-40e5-93ef-4749c7e84431 admin admin] PATH_INFO: `/v3/users/6d49b59c74bc42d38fb33c02491637da` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.237056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394d51b-94ca-40e5-93ef-4749c7e84431 admin admin] RBAC: Authorizing `identity:get_user(user_id=6d49b59c74bc42d38fb33c02491637da)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:28.239502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394d51b-94ca-40e5-93ef-4749c7e84431 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:28.241131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 134/270] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:28 2021] GET /identity/v3/users/6d49b59c74bc42d38fb33c02491637da => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:28.247339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:28.256845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272236df-77b0-4e59-bd2b-a023a2ba5226 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:28.261070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f132014-e98f-40ec-a64a-414822247022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:28.261909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132014-e98f-40ec-a64a-414822247022 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.262187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132014-e98f-40ec-a64a-414822247022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.262460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f132014-e98f-40ec-a64a-414822247022 admin admin] PATH_INFO: `/v3/system/users/6d49b59c74bc42d38fb33c02491637da/roles/4081ecccbbf04f3da4836fa060f64735` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.263953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f132014-e98f-40ec-a64a-414822247022 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6d49b59c74bc42d38fb33c02491637da, role_id=4081ecccbbf04f3da4836fa060f64735)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:28.265555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f132014-e98f-40ec-a64a-414822247022 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:28.338819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 137/271] 10.222.0.16 () {58 vars in 1355 bytes} [Thu Nov 11 16:55:28 2021] PUT /identity/v3/system/users/6d49b59c74bc42d38fb33c02491637da/roles/4081ecccbbf04f3da4836fa060f64735 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:28.546903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251080-033c-4ec7-9133-db6b2e378b36 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.547432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251080-033c-4ec7-9133-db6b2e378b36 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.547432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251080-033c-4ec7-9133-db6b2e378b36 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.549253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 135/272] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:28.555317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e68a1-e1de-403b-aead-73b48da1e51f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.555599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e68a1-e1de-403b-aead-73b48da1e51f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.555868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e68a1-e1de-403b-aead-73b48da1e51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.573749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ad4e68a1-e1de-403b-aead-73b48da1e51f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:28.574958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ad4e68a1-e1de-403b-aead-73b48da1e51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:28.583205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 138/273] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:28.606316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251080-033c-4ec7-9133-db6b2e378b36 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:28.618614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251080-033c-4ec7-9133-db6b2e378b36 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:28.622752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fbdcd-1977-40db-92d6-34d9d7a6bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:28.623559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbdcd-1977-40db-92d6-34d9d7a6bdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.623839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbdcd-1977-40db-92d6-34d9d7a6bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.624113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fbdcd-1977-40db-92d6-34d9d7a6bdd9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.625266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fbdcd-1977-40db-92d6-34d9d7a6bdd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:28.627026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fbdcd-1977-40db-92d6-34d9d7a6bdd9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:28.629117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 136/274] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:28.636849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e68a1-e1de-403b-aead-73b48da1e51f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:28.646403 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e68a1-e1de-403b-aead-73b48da1e51f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:28.650672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be570b38-b7aa-44c6-a342-d69bed9070b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:28.651326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570b38-b7aa-44c6-a342-d69bed9070b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:28.651605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570b38-b7aa-44c6-a342-d69bed9070b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:28.651870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be570b38-b7aa-44c6-a342-d69bed9070b0 admin admin] PATH_INFO: `/v3/groups` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:28.652569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be570b38-b7aa-44c6-a342-d69bed9070b0 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:28.654453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be570b38-b7aa-44c6-a342-d69bed9070b0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:28.759699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 139/275] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Nov 11 16:55:28 2021] POST /identity/v3/groups => generated 226 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:55:30.703439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4f0e-96c0-4853-a835-67b4830a497f None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:30.704019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4f0e-96c0-4853-a835-67b4830a497f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:30.704019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4f0e-96c0-4853-a835-67b4830a497f None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:30.706867 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 137/276] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:30.712724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14a105-a786-4d83-bfab-da5d33fd495d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:30.713200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14a105-a786-4d83-bfab-da5d33fd495d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:30.713283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14a105-a786-4d83-bfab-da5d33fd495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:30.731866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7f14a105-a786-4d83-bfab-da5d33fd495d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:30.733042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7f14a105-a786-4d83-bfab-da5d33fd495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:30.745222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 140/277] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:30.795744 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4f0e-96c0-4853-a835-67b4830a497f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:30.811266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4f0e-96c0-4853-a835-67b4830a497f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:30.816206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823174-0a5c-45ca-a29c-33a0b6863611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:30.816990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823174-0a5c-45ca-a29c-33a0b6863611 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:30.817294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823174-0a5c-45ca-a29c-33a0b6863611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:30.817583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823174-0a5c-45ca-a29c-33a0b6863611 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:30.832200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09823174-0a5c-45ca-a29c-33a0b6863611 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:30.839269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-09823174-0a5c-45ca-a29c-33a0b6863611 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 11 16:55:30.840731 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 138/278] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:30 2021] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:30.846836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14a105-a786-4d83-bfab-da5d33fd495d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:30.856128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14a105-a786-4d83-bfab-da5d33fd495d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:30.864418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:30.865094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:30.865373 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:30.865645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:30.866401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:30.866724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:30.868356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:30.882673 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 141/279] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:30 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:30.888998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823174-0a5c-45ca-a29c-33a0b6863611 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:30.900055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823174-0a5c-45ca-a29c-33a0b6863611 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:30.910315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d0f9d-b42c-42da-84a9-64ee3179315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:30.911218 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0f9d-b42c-42da-84a9-64ee3179315c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:30.911496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0f9d-b42c-42da-84a9-64ee3179315c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:30.911764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d0f9d-b42c-42da-84a9-64ee3179315c admin admin] PATH_INFO: `/v3/users/6d49b59c74bc42d38fb33c02491637da` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:30.912976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d0f9d-b42c-42da-84a9-64ee3179315c admin admin] RBAC: Authorizing `identity:get_user(user_id=6d49b59c74bc42d38fb33c02491637da)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:30.915223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d0f9d-b42c-42da-84a9-64ee3179315c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:30.919993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 139/280] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:55:30 2021] GET /identity/v3/users/6d49b59c74bc42d38fb33c02491637da => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:30.923470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:30.935192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6c762-adfd-47ae-b016-bffb883098dd admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:30.943164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0e83b-7d05-47f9-966e-cb4df55717a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:30.943818 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e83b-7d05-47f9-966e-cb4df55717a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:30.944094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e83b-7d05-47f9-966e-cb4df55717a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:30.944367 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e83b-7d05-47f9-966e-cb4df55717a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:30.945200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0e83b-7d05-47f9-966e-cb4df55717a2 admin admin] RBAC: Adding query filter params (role.id=4081ecccbbf04f3da4836fa060f64735, user.id=6d49b59c74bc42d38fb33c02491637da, scope.system=all) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:30.945502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0e83b-7d05-47f9-966e-cb4df55717a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:30.947379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0e83b-7d05-47f9-966e-cb4df55717a2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:30.966290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 142/281] 10.222.0.16 () {56 vars in 1329 bytes} [Thu Nov 11 16:55:30 2021] GET /identity/v3/role_assignments?user.id=6d49b59c74bc42d38fb33c02491637da&scope.system=all&role.id=4081ecccbbf04f3da4836fa060f64735 => generated 510 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:31.708904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229defa-9bb1-4f7e-b9bc-eca58e78aa81 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.709596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229defa-9bb1-4f7e-b9bc-eca58e78aa81 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.709596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229defa-9bb1-4f7e-b9bc-eca58e78aa81 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.711335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 140/282] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:31.718498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1094b-d63f-493d-bdb0-64c4292aca01 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.719149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1094b-d63f-493d-bdb0-64c4292aca01 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.719149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1094b-d63f-493d-bdb0-64c4292aca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.739381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-6fd1094b-d63f-493d-bdb0-64c4292aca01 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:31.740645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6fd1094b-d63f-493d-bdb0-64c4292aca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:31.751770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 143/283] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:31.794116 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229defa-9bb1-4f7e-b9bc-eca58e78aa81 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:31.816965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229defa-9bb1-4f7e-b9bc-eca58e78aa81 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:31.821776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c08572-1b3b-473f-94fb-cbef4fdd5b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:31.822618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08572-1b3b-473f-94fb-cbef4fdd5b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.822926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08572-1b3b-473f-94fb-cbef4fdd5b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.823201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c08572-1b3b-473f-94fb-cbef4fdd5b72 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.844153 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c08572-1b3b-473f-94fb-cbef4fdd5b72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:31.852243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-59c08572-1b3b-473f-94fb-cbef4fdd5b72 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:31.853730 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 141/284] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:31.860031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1094b-d63f-493d-bdb0-64c4292aca01 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:31.864572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf418fd-ee55-44e3-bafe-409325e42140 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.864820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf418fd-ee55-44e3-bafe-409325e42140 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.865098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf418fd-ee55-44e3-bafe-409325e42140 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.867209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 142/285] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:55:31.874402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab728-f7df-4fc3-a7b4-ddb9b5c17340 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.874709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab728-f7df-4fc3-a7b4-ddb9b5c17340 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.874987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ab728-f7df-4fc3-a7b4-ddb9b5c17340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.875864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1094b-d63f-493d-bdb0-64c4292aca01 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:31.887216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:31.887901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.888183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.888461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.889227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:31.889528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:31.891225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:31.900465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4c3ab728-f7df-4fc3-a7b4-ddb9b5c17340 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:31.901682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4c3ab728-f7df-4fc3-a7b4-ddb9b5c17340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:31.904660 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 144/286] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:31.911085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:31.921055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 143/287] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:31.924054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d887d-f47c-42d6-a495-3953625a838c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:31.928534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fe236-763b-4a32-8ad1-118bd7e5928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:31.929182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fe236-763b-4a32-8ad1-118bd7e5928d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.929467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fe236-763b-4a32-8ad1-118bd7e5928d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.929741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fe236-763b-4a32-8ad1-118bd7e5928d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.942320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fe236-763b-4a32-8ad1-118bd7e5928d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:31.944118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fe236-763b-4a32-8ad1-118bd7e5928d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:31.953511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ab728-f7df-4fc3-a7b4-ddb9b5c17340 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:31.963087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 145/288] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:55:31.963394 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ab728-f7df-4fc3-a7b4-ddb9b5c17340 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:31.973001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fe236-763b-4a32-8ad1-118bd7e5928d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:31.973668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912d6c-3ae2-4772-b4fb-7729ff1eefd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:31.974494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912d6c-3ae2-4772-b4fb-7729ff1eefd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.974856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912d6c-3ae2-4772-b4fb-7729ff1eefd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.975129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912d6c-3ae2-4772-b4fb-7729ff1eefd8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.985410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fe236-763b-4a32-8ad1-118bd7e5928d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:31.996047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bddd-4e42-47f6-a53c-2a38e061851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:31.996918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bddd-4e42-47f6-a53c-2a38e061851c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:31.997199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bddd-4e42-47f6-a53c-2a38e061851c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:31.997474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bddd-4e42-47f6-a53c-2a38e061851c admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:31.999032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2912d6c-3ae2-4772-b4fb-7729ff1eefd8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:31.999377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2bddd-4e42-47f6-a53c-2a38e061851c admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.001476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2bddd-4e42-47f6-a53c-2a38e061851c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.007721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 146/289] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:31 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:32.008150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c2912d6c-3ae2-4772-b4fb-7729ff1eefd8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:32.009534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 144/290] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:32.013262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bddd-4e42-47f6-a53c-2a38e061851c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.017765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912d6c-3ae2-4772-b4fb-7729ff1eefd8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.026502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bddd-4e42-47f6-a53c-2a38e061851c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.032207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912d6c-3ae2-4772-b4fb-7729ff1eefd8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.037519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.038186 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.038470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.038798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.039773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:32.040187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.041031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.041892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.042069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.042214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.042413 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.054661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 145/291] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.059067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.060104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:32.060104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:32.060104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:32.061367 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.064052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 147/292] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.066929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.069735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.077028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855e55-7699-47d7-8374-58ec5f34e66e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.081433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1f92e-5520-475f-bdfd-b55f3fe0849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.082075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f92e-5520-475f-bdfd-b55f3fe0849c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.082363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f92e-5520-475f-bdfd-b55f3fe0849c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.082666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f92e-5520-475f-bdfd-b55f3fe0849c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.083442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e1a38-1d7b-4075-a6e3-1bb6b9898bae admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.093819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1f92e-5520-475f-bdfd-b55f3fe0849c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.095784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1f92e-5520-475f-bdfd-b55f3fe0849c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.099318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.099994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.100274 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.100550 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.101400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] RBAC: Adding query filter params (group.id=a0fd33ba177345f2b98a28f061b998c4, role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=4b30188d19194873aed7f02c87d439bb) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:32.101708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.103637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.111664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 146/293] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:32.112519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 148/294] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/role_assignments?group.id=a0fd33ba177345f2b98a28f061b998c4&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.120433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1f92e-5520-475f-bdfd-b55f3fe0849c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.129964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1f92e-5520-475f-bdfd-b55f3fe0849c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.134632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd274f-a1ee-4913-b390-2c92f85b9d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.135574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd274f-a1ee-4913-b390-2c92f85b9d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.135904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd274f-a1ee-4913-b390-2c92f85b9d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.136179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd274f-a1ee-4913-b390-2c92f85b9d75 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.137490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd274f-a1ee-4913-b390-2c92f85b9d75 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.139740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd274f-a1ee-4913-b390-2c92f85b9d75 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.141900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 147/295] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.148229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.164767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39e66-eaee-422d-bf65-1a3f83ea7136 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.172198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf6ac2-4a8d-4849-8b67-78ad25749f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.173069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf6ac2-4a8d-4849-8b67-78ad25749f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.173347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf6ac2-4a8d-4849-8b67-78ad25749f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.173619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf6ac2-4a8d-4849-8b67-78ad25749f3c admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.179448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf6ac2-4a8d-4849-8b67-78ad25749f3c admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.181424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf6ac2-4a8d-4849-8b67-78ad25749f3c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.183237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 149/296] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.190115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd274f-a1ee-4913-b390-2c92f85b9d75 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.204994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd274f-a1ee-4913-b390-2c92f85b9d75 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.209658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777c066-20d7-49e8-abab-6e7c4b99051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.210358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777c066-20d7-49e8-abab-6e7c4b99051a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.214858 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777c066-20d7-49e8-abab-6e7c4b99051a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.215128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777c066-20d7-49e8-abab-6e7c4b99051a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.216070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777c066-20d7-49e8-abab-6e7c4b99051a admin admin] RBAC: Adding query filter params (group.id=a0fd33ba177345f2b98a28f061b998c4, role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=4b30188d19194873aed7f02c87d439bb) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:32.216436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777c066-20d7-49e8-abab-6e7c4b99051a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.218427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777c066-20d7-49e8-abab-6e7c4b99051a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.234936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 148/297] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/role_assignments?group.id=a0fd33ba177345f2b98a28f061b998c4&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=185d4a889ab64e4d84c11737116af86a => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.543751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278fa8-2db7-49a4-bbc9-09dfa7b3a55f None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.543751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278fa8-2db7-49a4-bbc9-09dfa7b3a55f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.543751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278fa8-2db7-49a4-bbc9-09dfa7b3a55f None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.544646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 150/298] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:32.551674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95c132-fd22-417b-8c52-b2b31e4f1b04 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.551932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95c132-fd22-417b-8c52-b2b31e4f1b04 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.552207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95c132-fd22-417b-8c52-b2b31e4f1b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.576686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ae95c132-fd22-417b-8c52-b2b31e4f1b04 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:32.577924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ae95c132-fd22-417b-8c52-b2b31e4f1b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:32.588224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 149/299] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:32.622964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac278fa8-2db7-49a4-bbc9-09dfa7b3a55f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.640399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac278fa8-2db7-49a4-bbc9-09dfa7b3a55f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.647365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d43f0-fa49-4096-a98a-d3db6797ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.648474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d43f0-fa49-4096-a98a-d3db6797ab18 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.648956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d43f0-fa49-4096-a98a-d3db6797ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.649417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d43f0-fa49-4096-a98a-d3db6797ab18 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.667417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d43f0-fa49-4096-a98a-d3db6797ab18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:32.677252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-9a4d43f0-fa49-4096-a98a-d3db6797ab18 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:32.679101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 151/300] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:32.685134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95c132-fd22-417b-8c52-b2b31e4f1b04 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.702963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95c132-fd22-417b-8c52-b2b31e4f1b04 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.708042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.708736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.709012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.709532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.710021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:32.710321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.711933 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.726248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 150/301] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.732619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d43f0-fa49-4096-a98a-d3db6797ab18 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.747609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d43f0-fa49-4096-a98a-d3db6797ab18 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.758422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287da304-50f8-49de-814f-32af54264d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.759470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da304-50f8-49de-814f-32af54264d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.759945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da304-50f8-49de-814f-32af54264d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.760423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da304-50f8-49de-814f-32af54264d9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.775280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287da304-50f8-49de-814f-32af54264d9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.777340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287da304-50f8-49de-814f-32af54264d9a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.795626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 152/302] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:32.802106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.820200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9882bc3-707e-4974-8938-fc312157d9d0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.835789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9ee21-2e39-45c4-9af8-61dec461ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.836659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9ee21-2e39-45c4-9af8-61dec461ae66 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.836935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9ee21-2e39-45c4-9af8-61dec461ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.837199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9ee21-2e39-45c4-9af8-61dec461ae66 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.838470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9ee21-2e39-45c4-9af8-61dec461ae66 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.840582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9ee21-2e39-45c4-9af8-61dec461ae66 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.848797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 151/303] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.850181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287da304-50f8-49de-814f-32af54264d9a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.862776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287da304-50f8-49de-814f-32af54264d9a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.874486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd682b0-548b-498d-bccc-ba03cbd7d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.875670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd682b0-548b-498d-bccc-ba03cbd7d3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.876144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd682b0-548b-498d-bccc-ba03cbd7d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.876616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd682b0-548b-498d-bccc-ba03cbd7d3e8 admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.878027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd682b0-548b-498d-bccc-ba03cbd7d3e8 admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.880141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd682b0-548b-498d-bccc-ba03cbd7d3e8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.882241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 153/304] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:32.888363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9ee21-2e39-45c4-9af8-61dec461ae66 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:32.898255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9ee21-2e39-45c4-9af8-61dec461ae66 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:32.906492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c52b15-7800-42ff-8f67-45c399776b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:32.907163 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c52b15-7800-42ff-8f67-45c399776b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:32.907443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c52b15-7800-42ff-8f67-45c399776b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:32.907714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c52b15-7800-42ff-8f67-45c399776b15 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:32.908550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c52b15-7800-42ff-8f67-45c399776b15 admin admin] RBAC: Adding query filter params (group.id=a0fd33ba177345f2b98a28f061b998c4, role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:32.909376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c52b15-7800-42ff-8f67-45c399776b15 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:32.911228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c52b15-7800-42ff-8f67-45c399776b15 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:32.917270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 152/305] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:32 2021] GET /identity/v3/role_assignments?group.id=a0fd33ba177345f2b98a28f061b998c4&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=185d4a889ab64e4d84c11737116af86a => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:33.118181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3519-bab1-4818-b65a-0eee3b2f6802 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.118590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3519-bab1-4818-b65a-0eee3b2f6802 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.118818 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3519-bab1-4818-b65a-0eee3b2f6802 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.120801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 154/306] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:33.127977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4b39-9d01-4130-b726-21ec64a8a3d1 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.128283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4b39-9d01-4130-b726-21ec64a8a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.128543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4b39-9d01-4130-b726-21ec64a8a3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.151712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ea2a4b39-9d01-4130-b726-21ec64a8a3d1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:33.152925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ea2a4b39-9d01-4130-b726-21ec64a8a3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:33.164364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 153/307] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:33.210612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea3519-bab1-4818-b65a-0eee3b2f6802 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.226730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea3519-bab1-4818-b65a-0eee3b2f6802 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.236470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaacf67-695b-4bc3-a381-28e98224c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.237829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacf67-695b-4bc3-a381-28e98224c485 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.238105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacf67-695b-4bc3-a381-28e98224c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.238377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacf67-695b-4bc3-a381-28e98224c485 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.261637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaacf67-695b-4bc3-a381-28e98224c485 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:33.269444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-bbaacf67-695b-4bc3-a381-28e98224c485 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:33.271167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 155/308] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:33.278802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a4b39-9d01-4130-b726-21ec64a8a3d1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.296745 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a4b39-9d01-4130-b726-21ec64a8a3d1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.302181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.302956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.303238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.303516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.304290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:33.304597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.306885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.316455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 154/309] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:33.322668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaacf67-695b-4bc3-a381-28e98224c485 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.337296 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaacf67-695b-4bc3-a381-28e98224c485 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.342271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9b5b4-4693-468c-a9ac-d3637b9d9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.343185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9b5b4-4693-468c-a9ac-d3637b9d9bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.343687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9b5b4-4693-468c-a9ac-d3637b9d9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.344154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9b5b4-4693-468c-a9ac-d3637b9d9bd6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.354701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9b5b4-4693-468c-a9ac-d3637b9d9bd6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.356757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9b5b4-4693-468c-a9ac-d3637b9d9bd6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.371129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 156/310] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:33.377229 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.396171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3921e-a16d-4589-933b-007d01c4b729 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.400916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c35ae9-dcbb-4a06-ad80-01ae52e8256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.401836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35ae9-dcbb-4a06-ad80-01ae52e8256e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.402118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35ae9-dcbb-4a06-ad80-01ae52e8256e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.402434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35ae9-dcbb-4a06-ad80-01ae52e8256e admin admin] PATH_INFO: `/v3/projects/a62f9c4d0b7f4443a8eb78e076640010` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.403722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c35ae9-dcbb-4a06-ad80-01ae52e8256e admin admin] RBAC: Authorizing `identity:get_project(project_id=a62f9c4d0b7f4443a8eb78e076640010)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.407677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c35ae9-dcbb-4a06-ad80-01ae52e8256e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.409468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 155/311] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/projects/a62f9c4d0b7f4443a8eb78e076640010 => generated 344 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:33.416147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9b5b4-4693-468c-a9ac-d3637b9d9bd6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.431925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9b5b4-4693-468c-a9ac-d3637b9d9bd6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.438201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75668a7-ac79-4df0-9690-3be5c59c5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.439365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75668a7-ac79-4df0-9690-3be5c59c5bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.439840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75668a7-ac79-4df0-9690-3be5c59c5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.440936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75668a7-ac79-4df0-9690-3be5c59c5bc4 admin admin] PATH_INFO: `/v3/groups/cad95c2837284f2aa3945b17cc1aac29` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.446825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75668a7-ac79-4df0-9690-3be5c59c5bc4 admin admin] RBAC: Authorizing `identity:get_group(group_id=cad95c2837284f2aa3945b17cc1aac29)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.449273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75668a7-ac79-4df0-9690-3be5c59c5bc4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.451602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 157/312] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/groups/cad95c2837284f2aa3945b17cc1aac29 => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:33.457649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c35ae9-dcbb-4a06-ad80-01ae52e8256e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.462064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571e7d-0c54-444b-8171-75d9dd667dfe None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.462653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571e7d-0c54-444b-8171-75d9dd667dfe None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.463248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571e7d-0c54-444b-8171-75d9dd667dfe None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.465369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 158/313] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:55:33.469509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c35ae9-dcbb-4a06-ad80-01ae52e8256e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.477926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77c82e-7d39-4981-a240-4b40be62c8ba None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.478585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77c82e-7d39-4981-a240-4b40be62c8ba None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.479064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77c82e-7d39-4981-a240-4b40be62c8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.484604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.485259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.485541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.485810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.486674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] RBAC: Adding query filter params (group.id=cad95c2837284f2aa3945b17cc1aac29, role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=a62f9c4d0b7f4443a8eb78e076640010) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:33.487506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.490111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.499697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 156/314] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/role_assignments?group.id=cad95c2837284f2aa3945b17cc1aac29&scope.project.id=a62f9c4d0b7f4443a8eb78e076640010&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:33.501671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ff77c82e-7d39-4981-a240-4b40be62c8ba None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:33.503759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ff77c82e-7d39-4981-a240-4b40be62c8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:33.512405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 159/315] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:33.539513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.549855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f22a31-3080-4ddc-b39f-2756a404c47e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.563384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74beb-cf32-4179-8958-762af8d7c4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.564222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74beb-cf32-4179-8958-762af8d7c4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.564503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74beb-cf32-4179-8958-762af8d7c4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.564776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc74beb-cf32-4179-8958-762af8d7c4d2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.580298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc74beb-cf32-4179-8958-762af8d7c4d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:33.587966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-efc74beb-cf32-4179-8958-762af8d7c4d2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:33.589229 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 157/316] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:33.596839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77c82e-7d39-4981-a240-4b40be62c8ba None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.612651 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77c82e-7d39-4981-a240-4b40be62c8ba None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.623282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.624322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.624807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.625331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.626489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:33.627084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.629053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.641716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 160/317] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:33.648537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74beb-cf32-4179-8958-762af8d7c4d2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.669764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc74beb-cf32-4179-8958-762af8d7c4d2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.676936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a5db3-0750-421d-aa96-77bf2fddc9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.677595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a5db3-0750-421d-aa96-77bf2fddc9ca admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.677874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a5db3-0750-421d-aa96-77bf2fddc9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.678147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a5db3-0750-421d-aa96-77bf2fddc9ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.691026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a5db3-0750-421d-aa96-77bf2fddc9ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.692872 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a5db3-0750-421d-aa96-77bf2fddc9ca admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.702973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 158/318] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:33.709964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.728285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb1b60-e156-4e44-9971-e4870287d097 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.737812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66565a32-e1cc-49f6-b8fb-c3c973d1d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.739868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66565a32-e1cc-49f6-b8fb-c3c973d1d62b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.740576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66565a32-e1cc-49f6-b8fb-c3c973d1d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.741047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66565a32-e1cc-49f6-b8fb-c3c973d1d62b admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.742668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66565a32-e1cc-49f6-b8fb-c3c973d1d62b admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.745207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66565a32-e1cc-49f6-b8fb-c3c973d1d62b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.747485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 161/319] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:33.754262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a5db3-0750-421d-aa96-77bf2fddc9ca admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.763600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a5db3-0750-421d-aa96-77bf2fddc9ca admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.774825 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194e94d-07c6-4264-90ac-95aededc8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.775702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194e94d-07c6-4264-90ac-95aededc8adc admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.775980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194e94d-07c6-4264-90ac-95aededc8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.776253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194e94d-07c6-4264-90ac-95aededc8adc admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.780338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194e94d-07c6-4264-90ac-95aededc8adc admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.781371 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-7194e94d-07c6-4264-90ac-95aededc8adc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:33.781371 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:55:33.781371 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:55:33.782622 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194e94d-07c6-4264-90ac-95aededc8adc admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.785115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 159/320] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:33.791546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66565a32-e1cc-49f6-b8fb-c3c973d1d62b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:33.805560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66565a32-e1cc-49f6-b8fb-c3c973d1d62b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:33.812385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2426d1-1531-430f-8bae-0463e821245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:33.813286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2426d1-1531-430f-8bae-0463e821245c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:33.813748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2426d1-1531-430f-8bae-0463e821245c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:33.814172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2426d1-1531-430f-8bae-0463e821245c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:33.815342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2426d1-1531-430f-8bae-0463e821245c admin admin] RBAC: Adding query filter params (group.id=a0fd33ba177345f2b98a28f061b998c4, role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:33.815815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2426d1-1531-430f-8bae-0463e821245c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:33.817982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2426d1-1531-430f-8bae-0463e821245c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:33.829123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 162/321] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:33 2021] GET /identity/v3/role_assignments?group.id=a0fd33ba177345f2b98a28f061b998c4&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:34.890776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a45-a648-41f0-aab0-219fb8cbfd09 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:34.891328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a45-a648-41f0-aab0-219fb8cbfd09 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:34.891328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a45-a648-41f0-aab0-219fb8cbfd09 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:34.893408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 160/322] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:34.899723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542795fc-36b9-46e6-b005-0bd7d2e97b33 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:34.900178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542795fc-36b9-46e6-b005-0bd7d2e97b33 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:34.900275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542795fc-36b9-46e6-b005-0bd7d2e97b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:34.919206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-542795fc-36b9-46e6-b005-0bd7d2e97b33 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:34.920579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-542795fc-36b9-46e6-b005-0bd7d2e97b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:34.934649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 163/323] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:34.952524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723a45-a648-41f0-aab0-219fb8cbfd09 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:34.964667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723a45-a648-41f0-aab0-219fb8cbfd09 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:34.969127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d1578-e90f-4148-9f6b-c154e5b5e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:34.969924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d1578-e90f-4148-9f6b-c154e5b5e615 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:34.970209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d1578-e90f-4148-9f6b-c154e5b5e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:34.970479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d1578-e90f-4148-9f6b-c154e5b5e615 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:34.981504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d1578-e90f-4148-9f6b-c154e5b5e615 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:34.989686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-6a7d1578-e90f-4148-9f6b-c154e5b5e615 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:34.994659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 161/324] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:34.997647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542795fc-36b9-46e6-b005-0bd7d2e97b33 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.007477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542795fc-36b9-46e6-b005-0bd7d2e97b33 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.012062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.012720 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.012999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.013273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.014029 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:35.014330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:35.015973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:35.030656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 164/325] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:35.032294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d1578-e90f-4148-9f6b-c154e5b5e615 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.042164 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d1578-e90f-4148-9f6b-c154e5b5e615 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.046578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3cf4a-7bc0-4124-99d6-1d41bfd97538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.047453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3cf4a-7bc0-4124-99d6-1d41bfd97538 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.047735 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3cf4a-7bc0-4124-99d6-1d41bfd97538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.048005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3cf4a-7bc0-4124-99d6-1d41bfd97538 admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.049183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3cf4a-7bc0-4124-99d6-1d41bfd97538 admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:35.051644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3cf4a-7bc0-4124-99d6-1d41bfd97538 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:35.056082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 162/326] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:35 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:35.059804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.071868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb02727-03bd-4300-b42e-8e52009670ee admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.076591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f026e-9e24-4056-9331-6e889806cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.077484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f026e-9e24-4056-9331-6e889806cfda admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.077767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f026e-9e24-4056-9331-6e889806cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.078040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f026e-9e24-4056-9331-6e889806cfda admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.080614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f026e-9e24-4056-9331-6e889806cfda admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:35.082914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f026e-9e24-4056-9331-6e889806cfda admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:35.085032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 165/327] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:35 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:35.091371 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3cf4a-7bc0-4124-99d6-1d41bfd97538 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.102699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3cf4a-7bc0-4124-99d6-1d41bfd97538 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.107159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66131b4b-93ec-4ed2-ab80-491cc99f9601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.108083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131b4b-93ec-4ed2-ab80-491cc99f9601 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.108363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131b4b-93ec-4ed2-ab80-491cc99f9601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.108679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131b4b-93ec-4ed2-ab80-491cc99f9601 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb/groups/a0fd33ba177345f2b98a28f061b998c4/roles/c6ba186164fa477bb92f50bf3180c74d` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.111045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66131b4b-93ec-4ed2-ab80-491cc99f9601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b30188d19194873aed7f02c87d439bb, group_id=a0fd33ba177345f2b98a28f061b998c4, role_id=c6ba186164fa477bb92f50bf3180c74d)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:35.114657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66131b4b-93ec-4ed2-ab80-491cc99f9601 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:35.196537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 163/328] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Nov 11 16:55:35 2021] PUT /identity/v3/projects/4b30188d19194873aed7f02c87d439bb/groups/a0fd33ba177345f2b98a28f061b998c4/roles/c6ba186164fa477bb92f50bf3180c74d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:55:35.360417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2161-0bfa-41db-84d0-2553b2044b32 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.360751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2161-0bfa-41db-84d0-2553b2044b32 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.360960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2161-0bfa-41db-84d0-2553b2044b32 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.364000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 166/329] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:35.373748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83f35-6424-47d0-990d-08284d5aef62 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.374055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83f35-6424-47d0-990d-08284d5aef62 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.374303 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83f35-6424-47d0-990d-08284d5aef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.397350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-96b83f35-6424-47d0-990d-08284d5aef62 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:35.398574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-96b83f35-6424-47d0-990d-08284d5aef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:35.477199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 164/330] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:35.510114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b2161-0bfa-41db-84d0-2553b2044b32 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.524882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b2161-0bfa-41db-84d0-2553b2044b32 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.530467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a13cb-20ae-48b1-a396-c1758f912d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.531279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a13cb-20ae-48b1-a396-c1758f912d76 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.531559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a13cb-20ae-48b1-a396-c1758f912d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.531832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a13cb-20ae-48b1-a396-c1758f912d76 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.543652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a13cb-20ae-48b1-a396-c1758f912d76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:35.550766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-e22a13cb-20ae-48b1-a396-c1758f912d76 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:35.551981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 167/331] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:35.559016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b83f35-6424-47d0-990d-08284d5aef62 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.568476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b83f35-6424-47d0-990d-08284d5aef62 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.576927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.577656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.577935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.578205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.579059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:35.579365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:35.581617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:35.590955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 165/332] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:35.599379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a13cb-20ae-48b1-a396-c1758f912d76 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.609974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a13cb-20ae-48b1-a396-c1758f912d76 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.617730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b51b1-ad83-46f6-b0ea-948950d90719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.618616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b51b1-ad83-46f6-b0ea-948950d90719 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.618899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b51b1-ad83-46f6-b0ea-948950d90719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.619170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b51b1-ad83-46f6-b0ea-948950d90719 admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.620385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b51b1-ad83-46f6-b0ea-948950d90719 admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:35.622316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b51b1-ad83-46f6-b0ea-948950d90719 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:35.624101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 168/333] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:35 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:35.630650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.640892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0b78-7d21-4a3e-b288-c3e020c8606c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.647941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a833a01-e81b-41e9-bbe2-c8f0305a1c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.648852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a833a01-e81b-41e9-bbe2-c8f0305a1c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.649132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a833a01-e81b-41e9-bbe2-c8f0305a1c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.649405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a833a01-e81b-41e9-bbe2-c8f0305a1c38 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.650669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a833a01-e81b-41e9-bbe2-c8f0305a1c38 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:35.652898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a833a01-e81b-41e9-bbe2-c8f0305a1c38 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:35.654981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 166/334] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:35 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:35.661899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b51b1-ad83-46f6-b0ea-948950d90719 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:35.672340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b51b1-ad83-46f6-b0ea-948950d90719 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:35.679172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df53fbc-a7fe-4482-a32b-2c9ec82ac46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:35.680333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53fbc-a7fe-4482-a32b-2c9ec82ac46f admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:35.680833 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53fbc-a7fe-4482-a32b-2c9ec82ac46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:35.681308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53fbc-a7fe-4482-a32b-2c9ec82ac46f admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb/groups/a0fd33ba177345f2b98a28f061b998c4/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:35.683574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df53fbc-a7fe-4482-a32b-2c9ec82ac46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b30188d19194873aed7f02c87d439bb, group_id=a0fd33ba177345f2b98a28f061b998c4, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:35.686461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df53fbc-a7fe-4482-a32b-2c9ec82ac46f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:35.796337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 169/335] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Nov 11 16:55:35 2021] PUT /identity/v3/projects/4b30188d19194873aed7f02c87d439bb/groups/a0fd33ba177345f2b98a28f061b998c4/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:36.216520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d438b-2338-4d91-b80f-18acec590695 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.217055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d438b-2338-4d91-b80f-18acec590695 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.217055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d438b-2338-4d91-b80f-18acec590695 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.219017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 167/336] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:36.225482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269159b-f89f-480c-8633-782c2e70b3fb None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.226312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269159b-f89f-480c-8633-782c2e70b3fb None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.226834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269159b-f89f-480c-8633-782c2e70b3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.254920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-5269159b-f89f-480c-8633-782c2e70b3fb None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:36.257205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5269159b-f89f-480c-8633-782c2e70b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:36.332023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 170/337] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:36.367880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d438b-2338-4d91-b80f-18acec590695 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.384321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d438b-2338-4d91-b80f-18acec590695 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.395468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a6777-e19b-4977-bd25-2b16cb64cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.396279 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a6777-e19b-4977-bd25-2b16cb64cb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.396555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a6777-e19b-4977-bd25-2b16cb64cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.396826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a6777-e19b-4977-bd25-2b16cb64cb7b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.420617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a6777-e19b-4977-bd25-2b16cb64cb7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:36.428181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-260a6777-e19b-4977-bd25-2b16cb64cb7b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:36.434647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 168/338] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:36.436208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269159b-f89f-480c-8633-782c2e70b3fb None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.451941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269159b-f89f-480c-8633-782c2e70b3fb None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.458170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.459126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.459612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.460094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.461296 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:36.461826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:36.463662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:36.477685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 171/339] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:36.485240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a6777-e19b-4977-bd25-2b16cb64cb7b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.496770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a6777-e19b-4977-bd25-2b16cb64cb7b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.507976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f957ec-0feb-42ef-b4fc-b88b92fe4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.508831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f957ec-0feb-42ef-b4fc-b88b92fe4a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.509109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f957ec-0feb-42ef-b4fc-b88b92fe4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.509387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f957ec-0feb-42ef-b4fc-b88b92fe4a47 admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.515264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f957ec-0feb-42ef-b4fc-b88b92fe4a47 admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:36.517193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f957ec-0feb-42ef-b4fc-b88b92fe4a47 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:36.519208 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 169/340] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:36 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:36.525382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.539018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064126-d84f-475a-a4a1-920e9b55a114 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.545340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4cc3f-2939-4759-92a8-187bbd94c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.546486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cc3f-2939-4759-92a8-187bbd94c88a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.547019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cc3f-2939-4759-92a8-187bbd94c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.547493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cc3f-2939-4759-92a8-187bbd94c88a admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.548933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4cc3f-2939-4759-92a8-187bbd94c88a admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:36.551914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4cc3f-2939-4759-92a8-187bbd94c88a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:36.558579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 172/341] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:36 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:36.560277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f957ec-0feb-42ef-b4fc-b88b92fe4a47 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.576158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f957ec-0feb-42ef-b4fc-b88b92fe4a47 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.586562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2166e-8c3a-469e-92d3-2ea48847d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.587440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2166e-8c3a-469e-92d3-2ea48847d861 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.587733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2166e-8c3a-469e-92d3-2ea48847d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.587994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2166e-8c3a-469e-92d3-2ea48847d861 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/groups/a0fd33ba177345f2b98a28f061b998c4/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.595901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2166e-8c3a-469e-92d3-2ea48847d861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4565572e31b4ffe8a733d9183cd77c5, group_id=a0fd33ba177345f2b98a28f061b998c4, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:36.599288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2166e-8c3a-469e-92d3-2ea48847d861 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:36.622349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d4f5-ffb4-496e-a99f-d4a3246cdf6d None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.622978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d4f5-ffb4-496e-a99f-d4a3246cdf6d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.623455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d4f5-ffb4-496e-a99f-d4a3246cdf6d None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.625756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 173/342] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:36.631797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d4cd-401f-43c9-a03c-9c5bb8a6a05b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.632345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d4cd-401f-43c9-a03c-9c5bb8a6a05b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.632844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d4cd-401f-43c9-a03c-9c5bb8a6a05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.652396 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b806d4cd-401f-43c9-a03c-9c5bb8a6a05b None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:36.653581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b806d4cd-401f-43c9-a03c-9c5bb8a6a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:36.664622 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 170/343] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Nov 11 16:55:36 2021] PUT /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/groups/a0fd33ba177345f2b98a28f061b998c4/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:36.668169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 174/344] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:36.693528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2166e-8c3a-469e-92d3-2ea48847d861 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.771446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2166e-8c3a-469e-92d3-2ea48847d861 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.781242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb0957-b138-4245-8fb5-6d9ffae1d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.782835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0957-b138-4245-8fb5-6d9ffae1d878 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.783542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0957-b138-4245-8fb5-6d9ffae1d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.784602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb0957-b138-4245-8fb5-6d9ffae1d878 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.811920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb0957-b138-4245-8fb5-6d9ffae1d878 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:36.822620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-64cb0957-b138-4245-8fb5-6d9ffae1d878 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:36.825111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 171/345] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:36.831593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806d4cd-401f-43c9-a03c-9c5bb8a6a05b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.842797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806d4cd-401f-43c9-a03c-9c5bb8a6a05b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.853183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.853978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.854261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.854595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.855413 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:36.855729 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:36.857440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:36.873983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 175/346] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:36.881189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb0957-b138-4245-8fb5-6d9ffae1d878 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.896362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb0957-b138-4245-8fb5-6d9ffae1d878 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.903191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dc92-594a-4c29-a1d3-08aa40cf0e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.904449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dc92-594a-4c29-a1d3-08aa40cf0e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.904941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dc92-594a-4c29-a1d3-08aa40cf0e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.905446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654dc92-594a-4c29-a1d3-08aa40cf0e1f admin admin] PATH_INFO: `/v3/groups/cad95c2837284f2aa3945b17cc1aac29` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.907057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654dc92-594a-4c29-a1d3-08aa40cf0e1f admin admin] RBAC: Authorizing `identity:get_group(group_id=cad95c2837284f2aa3945b17cc1aac29)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:36.909796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654dc92-594a-4c29-a1d3-08aa40cf0e1f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:36.913875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 172/347] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:36 2021] GET /identity/v3/groups/cad95c2837284f2aa3945b17cc1aac29 => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:36.920365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.936249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451590e0-0767-4b7b-9726-62172e68b2fd admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.947387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db7cc-02df-40e3-bd75-9cee031b7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.948246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db7cc-02df-40e3-bd75-9cee031b7a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.948522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db7cc-02df-40e3-bd75-9cee031b7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.948843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db7cc-02df-40e3-bd75-9cee031b7a0b admin admin] PATH_INFO: `/v3/projects/a62f9c4d0b7f4443a8eb78e076640010` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.951008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db7cc-02df-40e3-bd75-9cee031b7a0b admin admin] RBAC: Authorizing `identity:get_project(project_id=a62f9c4d0b7f4443a8eb78e076640010)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:36.952949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db7cc-02df-40e3-bd75-9cee031b7a0b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:36.955249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 176/348] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:36 2021] GET /identity/v3/projects/a62f9c4d0b7f4443a8eb78e076640010 => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:36.962210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dc92-594a-4c29-a1d3-08aa40cf0e1f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:36.976508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654dc92-594a-4c29-a1d3-08aa40cf0e1f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:36.981152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ddff-ff86-47ba-a601-1872be3eff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:36.982068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ddff-ff86-47ba-a601-1872be3eff5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:36.982390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ddff-ff86-47ba-a601-1872be3eff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:36.982693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ddff-ff86-47ba-a601-1872be3eff5a admin admin] PATH_INFO: `/v3/projects/a62f9c4d0b7f4443a8eb78e076640010/groups/cad95c2837284f2aa3945b17cc1aac29/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:36.984822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459ddff-ff86-47ba-a601-1872be3eff5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62f9c4d0b7f4443a8eb78e076640010, group_id=cad95c2837284f2aa3945b17cc1aac29, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:36.988280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459ddff-ff86-47ba-a601-1872be3eff5a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:37.065003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 173/349] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Nov 11 16:55:36 2021] PUT /identity/v3/projects/a62f9c4d0b7f4443a8eb78e076640010/groups/cad95c2837284f2aa3945b17cc1aac29/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:37.250326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0d796-3654-4e43-8b53-76a59bb008a1 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:37.250858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0d796-3654-4e43-8b53-76a59bb008a1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:37.250858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0d796-3654-4e43-8b53-76a59bb008a1 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:37.253580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 177/350] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:37.259971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919629-7242-4dbc-9cd5-639edd9a5b40 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:37.260473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919629-7242-4dbc-9cd5-639edd9a5b40 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:37.260550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919629-7242-4dbc-9cd5-639edd9a5b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:37.281386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1a919629-7242-4dbc-9cd5-639edd9a5b40 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:37.282594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1a919629-7242-4dbc-9cd5-639edd9a5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:37.358998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 174/351] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:37.398532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0d796-3654-4e43-8b53-76a59bb008a1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:37.411531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0d796-3654-4e43-8b53-76a59bb008a1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:37.418141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d824d4-becb-4f18-bfdc-edf71813ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:37.418970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d824d4-becb-4f18-bfdc-edf71813ab2b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:37.419245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d824d4-becb-4f18-bfdc-edf71813ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:37.419513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d824d4-becb-4f18-bfdc-edf71813ab2b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:37.431037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d824d4-becb-4f18-bfdc-edf71813ab2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:37.438635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-85d824d4-becb-4f18-bfdc-edf71813ab2b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:37.441959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 178/352] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:37.451029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919629-7242-4dbc-9cd5-639edd9a5b40 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:37.464007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919629-7242-4dbc-9cd5-639edd9a5b40 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:37.468627 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:37.469293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:37.469569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:37.469840 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:37.470637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:37.470946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:37.472599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:37.482448 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 175/353] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:37.490679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d824d4-becb-4f18-bfdc-edf71813ab2b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:37.501333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d824d4-becb-4f18-bfdc-edf71813ab2b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:37.507871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a85a7-7883-4b74-a690-4fb0da4c41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:37.508766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a85a7-7883-4b74-a690-4fb0da4c41e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:37.509043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a85a7-7883-4b74-a690-4fb0da4c41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:37.509313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a85a7-7883-4b74-a690-4fb0da4c41e0 admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:37.510580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a85a7-7883-4b74-a690-4fb0da4c41e0 admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:37.512535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a85a7-7883-4b74-a690-4fb0da4c41e0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:37.518895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 179/354] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:37 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:37.521292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:37.532448 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccfc50-fae7-4f44-8e09-6cebf56724fb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:37.537760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1aeaf4-c22f-4ef1-94ee-64775b6398e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:37.538716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aeaf4-c22f-4ef1-94ee-64775b6398e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:37.538995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aeaf4-c22f-4ef1-94ee-64775b6398e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:37.539311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1aeaf4-c22f-4ef1-94ee-64775b6398e7 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:37.540565 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1aeaf4-c22f-4ef1-94ee-64775b6398e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:37.542766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1aeaf4-c22f-4ef1-94ee-64775b6398e7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:37.550460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 176/355] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:37 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:37.551832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a85a7-7883-4b74-a690-4fb0da4c41e0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:37.562276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a85a7-7883-4b74-a690-4fb0da4c41e0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:37.567050 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f272fb-07d2-4bc0-9869-b09bd04e8e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:37.567975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f272fb-07d2-4bc0-9869-b09bd04e8e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:37.568255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f272fb-07d2-4bc0-9869-b09bd04e8e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:37.568579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f272fb-07d2-4bc0-9869-b09bd04e8e36 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/groups/a0fd33ba177345f2b98a28f061b998c4/roles/c6ba186164fa477bb92f50bf3180c74d` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:37.570986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f272fb-07d2-4bc0-9869-b09bd04e8e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4565572e31b4ffe8a733d9183cd77c5, group_id=a0fd33ba177345f2b98a28f061b998c4, role_id=c6ba186164fa477bb92f50bf3180c74d)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:37.573792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f272fb-07d2-4bc0-9869-b09bd04e8e36 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:37.657514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 180/356] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Nov 11 16:55:37 2021] PUT /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5/groups/a0fd33ba177345f2b98a28f061b998c4/roles/c6ba186164fa477bb92f50bf3180c74d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:38.524678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de2e3-ba8d-477b-9d82-c6e6411d2dcf None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:38.525172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de2e3-ba8d-477b-9d82-c6e6411d2dcf None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:38.525172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de2e3-ba8d-477b-9d82-c6e6411d2dcf None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:38.527081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 177/357] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:38.533141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f56508-78fa-4299-8cdb-f692d35cd8c8 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:38.533541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f56508-78fa-4299-8cdb-f692d35cd8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:38.533706 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f56508-78fa-4299-8cdb-f692d35cd8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:38.556286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e1f56508-78fa-4299-8cdb-f692d35cd8c8 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:38.557466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e1f56508-78fa-4299-8cdb-f692d35cd8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:38.633763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 181/358] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:38.675308 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0de2e3-ba8d-477b-9d82-c6e6411d2dcf None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:38.693526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0de2e3-ba8d-477b-9d82-c6e6411d2dcf None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:38.700718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf234412-f511-4fc6-be38-5af9476c0004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:38.701535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234412-f511-4fc6-be38-5af9476c0004 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:38.701813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234412-f511-4fc6-be38-5af9476c0004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:38.702147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234412-f511-4fc6-be38-5af9476c0004 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:38.715032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf234412-f511-4fc6-be38-5af9476c0004 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:38.722871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-bf234412-f511-4fc6-be38-5af9476c0004 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:38.725358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 178/359] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:38.731166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f56508-78fa-4299-8cdb-f692d35cd8c8 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:38.741313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f56508-78fa-4299-8cdb-f692d35cd8c8 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:38.753677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:38.754353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:38.754658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:38.754935 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:38.755697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:38.756002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:38.757619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:38.766379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 182/360] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:38.773867 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf234412-f511-4fc6-be38-5af9476c0004 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:38.786664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf234412-f511-4fc6-be38-5af9476c0004 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:38.794657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61ec07-ed6c-4046-b519-7731feded653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:38.795397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61ec07-ed6c-4046-b519-7731feded653 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:38.795683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61ec07-ed6c-4046-b519-7731feded653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:38.795953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61ec07-ed6c-4046-b519-7731feded653 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:38.808710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61ec07-ed6c-4046-b519-7731feded653 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:38.810612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61ec07-ed6c-4046-b519-7731feded653 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:38.824232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 179/361] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:38.831671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:38.841805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd26104-2f71-4d80-b285-4c7c156720d7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:38.851851 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755a8de-1b05-4b92-9127-c271c3bebcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:38.852763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755a8de-1b05-4b92-9127-c271c3bebcfc admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:38.853096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755a8de-1b05-4b92-9127-c271c3bebcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:38.853371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755a8de-1b05-4b92-9127-c271c3bebcfc admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:38.855114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755a8de-1b05-4b92-9127-c271c3bebcfc admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:38.857281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755a8de-1b05-4b92-9127-c271c3bebcfc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:38.859133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 183/362] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:38 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:38.866052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61ec07-ed6c-4046-b519-7731feded653 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:38.875340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61ec07-ed6c-4046-b519-7731feded653 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:38.885685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c2d57-9612-48fd-bb0e-1b0727ac7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:38.885685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2d57-9612-48fd-bb0e-1b0727ac7673 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:38.885685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2d57-9612-48fd-bb0e-1b0727ac7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:38.885685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2d57-9612-48fd-bb0e-1b0727ac7673 admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:38.885987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c2d57-9612-48fd-bb0e-1b0727ac7673 admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:38.886863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c2d57-9612-48fd-bb0e-1b0727ac7673 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:38.889524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 180/363] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:38 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:38.895346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755a8de-1b05-4b92-9127-c271c3bebcfc admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:38.910112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755a8de-1b05-4b92-9127-c271c3bebcfc admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:38.918657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f6fea-298a-4e2c-bbd9-19d9fdc8046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:38.919313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f6fea-298a-4e2c-bbd9-19d9fdc8046d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:38.919593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f6fea-298a-4e2c-bbd9-19d9fdc8046d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:38.919862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f6fea-298a-4e2c-bbd9-19d9fdc8046d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:38.920745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f6fea-298a-4e2c-bbd9-19d9fdc8046d admin admin] RBAC: Adding query filter params (group.id=a0fd33ba177345f2b98a28f061b998c4, role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=4b30188d19194873aed7f02c87d439bb) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:38.921052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f6fea-298a-4e2c-bbd9-19d9fdc8046d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:38.922918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f6fea-298a-4e2c-bbd9-19d9fdc8046d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:38.944106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 184/364] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:38 2021] GET /identity/v3/role_assignments?group.id=a0fd33ba177345f2b98a28f061b998c4&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:39.139339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9908-298a-4cde-a5f9-46aa64114551 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.139721 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9908-298a-4cde-a5f9-46aa64114551 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.139915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9908-298a-4cde-a5f9-46aa64114551 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.141995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 181/365] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:39.150422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0885a-7853-40e7-b63b-2634351f7805 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.151037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0885a-7853-40e7-b63b-2634351f7805 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.151513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0885a-7853-40e7-b63b-2634351f7805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.182422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-71f0885a-7853-40e7-b63b-2634351f7805 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:39.183973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-71f0885a-7853-40e7-b63b-2634351f7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:39.192980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 185/366] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:39.238202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9908-298a-4cde-a5f9-46aa64114551 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.257581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9908-298a-4cde-a5f9-46aa64114551 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.266605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c64d49-ef1a-45ec-a247-0857c23fe939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.267439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c64d49-ef1a-45ec-a247-0857c23fe939 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.267727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c64d49-ef1a-45ec-a247-0857c23fe939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.268003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c64d49-ef1a-45ec-a247-0857c23fe939 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.283654 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c64d49-ef1a-45ec-a247-0857c23fe939 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:39.291570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-15c64d49-ef1a-45ec-a247-0857c23fe939 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:39.293152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 182/367] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:39.299493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0885a-7853-40e7-b63b-2634351f7805 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.312144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0885a-7853-40e7-b63b-2634351f7805 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.318598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.319562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.320059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.320526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.321474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:39.321982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.323791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.336269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 186/368] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:39.342352 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c64d49-ef1a-45ec-a247-0857c23fe939 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.355592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c64d49-ef1a-45ec-a247-0857c23fe939 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.362939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6e4c5-289d-43ea-a41c-9d863bbc6ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.363594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6e4c5-289d-43ea-a41c-9d863bbc6ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.364130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6e4c5-289d-43ea-a41c-9d863bbc6ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.364407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6e4c5-289d-43ea-a41c-9d863bbc6ed9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.374965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6e4c5-289d-43ea-a41c-9d863bbc6ed9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.376776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6e4c5-289d-43ea-a41c-9d863bbc6ed9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.390402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 183/369] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:39.397068 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.412596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3213a-33c1-4042-9a49-c6ddb5ffb59c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.424618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ed88a-4649-4416-95e9-b55fdb147350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.425775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ed88a-4649-4416-95e9-b55fdb147350 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.426246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ed88a-4649-4416-95e9-b55fdb147350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.426727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ed88a-4649-4416-95e9-b55fdb147350 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.431526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ed88a-4649-4416-95e9-b55fdb147350 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.433678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ed88a-4649-4416-95e9-b55fdb147350 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.435862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 187/370] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:39.442119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6e4c5-289d-43ea-a41c-9d863bbc6ed9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.451171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6e4c5-289d-43ea-a41c-9d863bbc6ed9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.456302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b7385-0cc6-4eb3-a49e-5a719f25dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.457189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7385-0cc6-4eb3-a49e-5a719f25dc12 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.457475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7385-0cc6-4eb3-a49e-5a719f25dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.457749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7385-0cc6-4eb3-a49e-5a719f25dc12 admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.461504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7385-0cc6-4eb3-a49e-5a719f25dc12 admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.463549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7385-0cc6-4eb3-a49e-5a719f25dc12 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.465462 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 184/371] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:39.472225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ed88a-4649-4416-95e9-b55fdb147350 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.482471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ed88a-4649-4416-95e9-b55fdb147350 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.491460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15860ea-d1a0-4b41-916f-b9284d1b4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.492115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15860ea-d1a0-4b41-916f-b9284d1b4e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.492394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15860ea-d1a0-4b41-916f-b9284d1b4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.492663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15860ea-d1a0-4b41-916f-b9284d1b4e82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.493511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15860ea-d1a0-4b41-916f-b9284d1b4e82 admin admin] RBAC: Adding query filter params (group.id=a0fd33ba177345f2b98a28f061b998c4, role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=4b30188d19194873aed7f02c87d439bb) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:39.493816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15860ea-d1a0-4b41-916f-b9284d1b4e82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.495759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15860ea-d1a0-4b41-916f-b9284d1b4e82 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.505522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 188/372] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/role_assignments?group.id=a0fd33ba177345f2b98a28f061b998c4&scope.project.id=4b30188d19194873aed7f02c87d439bb&role.id=185d4a889ab64e4d84c11737116af86a => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:39.707276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79c65-71e3-49ba-b660-be3649f61bf9 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.707776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79c65-71e3-49ba-b660-be3649f61bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.707776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79c65-71e3-49ba-b660-be3649f61bf9 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.709832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 185/373] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:39.716263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262aff-0709-4d07-a787-b4a84fa32881 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.716896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262aff-0709-4d07-a787-b4a84fa32881 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.716896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262aff-0709-4d07-a787-b4a84fa32881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.736094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-25262aff-0709-4d07-a787-b4a84fa32881 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:39.737326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-25262aff-0709-4d07-a787-b4a84fa32881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:39.745625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 189/374] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:39.772579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be79c65-71e3-49ba-b660-be3649f61bf9 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.785238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be79c65-71e3-49ba-b660-be3649f61bf9 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.789677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a28a6f-57c0-4ac9-ba41-1ae2d0362e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.790520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28a6f-57c0-4ac9-ba41-1ae2d0362e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.790830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28a6f-57c0-4ac9-ba41-1ae2d0362e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.791103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a28a6f-57c0-4ac9-ba41-1ae2d0362e39 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.802144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a28a6f-57c0-4ac9-ba41-1ae2d0362e39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:39.809404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-22a28a6f-57c0-4ac9-ba41-1ae2d0362e39 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 11 16:55:39.810963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 186/375] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:39.817939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25262aff-0709-4d07-a787-b4a84fa32881 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.827464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25262aff-0709-4d07-a787-b4a84fa32881 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.833027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.833696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.833977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.834251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.835043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:39.835351 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.837277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.847829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 190/376] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:39.854935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a28a6f-57c0-4ac9-ba41-1ae2d0362e39 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.869936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a28a6f-57c0-4ac9-ba41-1ae2d0362e39 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.878764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0c9c-6800-4f29-b4af-09c2646f2b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.879802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0c9c-6800-4f29-b4af-09c2646f2b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.880242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0c9c-6800-4f29-b4af-09c2646f2b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.883871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0c9c-6800-4f29-b4af-09c2646f2b66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.890655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c0c9c-6800-4f29-b4af-09c2646f2b66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.892641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c0c9c-6800-4f29-b4af-09c2646f2b66 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.903301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 187/377] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:39.909577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.921255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bbcc2-5d32-4986-82f6-68860646b465 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.927093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4433b-e2d1-49d3-92ff-235b66ea2ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.927949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4433b-e2d1-49d3-92ff-235b66ea2ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.928224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4433b-e2d1-49d3-92ff-235b66ea2ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.928487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4433b-e2d1-49d3-92ff-235b66ea2ca7 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.932325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4433b-e2d1-49d3-92ff-235b66ea2ca7 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.932523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4433b-e2d1-49d3-92ff-235b66ea2ca7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.934357 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 191/378] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:39.941289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0c9c-6800-4f29-b4af-09c2646f2b66 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.951987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0c9c-6800-4f29-b4af-09c2646f2b66 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.958965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd6017-b786-4695-a252-6c13a7500948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.960099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6017-b786-4695-a252-6c13a7500948 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.960595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6017-b786-4695-a252-6c13a7500948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.960873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6017-b786-4695-a252-6c13a7500948 admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.962080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd6017-b786-4695-a252-6c13a7500948 admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.964007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd6017-b786-4695-a252-6c13a7500948 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.965782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 188/379] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:39.972129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4433b-e2d1-49d3-92ff-235b66ea2ca7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:39.981916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4433b-e2d1-49d3-92ff-235b66ea2ca7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:39.986330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3df2e-3019-482c-837f-1a40f2c17299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:39.987547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3df2e-3019-482c-837f-1a40f2c17299 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:39.987826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3df2e-3019-482c-837f-1a40f2c17299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:39.988096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3df2e-3019-482c-837f-1a40f2c17299 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:39.989191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3df2e-3019-482c-837f-1a40f2c17299 admin admin] RBAC: Adding query filter params (group.id=a0fd33ba177345f2b98a28f061b998c4, role.id=185d4a889ab64e4d84c11737116af86a, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:39.989509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3df2e-3019-482c-837f-1a40f2c17299 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:39.991359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3df2e-3019-482c-837f-1a40f2c17299 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:39.998137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 192/380] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:39 2021] GET /identity/v3/role_assignments?group.id=a0fd33ba177345f2b98a28f061b998c4&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=185d4a889ab64e4d84c11737116af86a => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:40.013280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96c35-9746-4c18-8d2f-b91c2ebfefa3 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.013601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96c35-9746-4c18-8d2f-b91c2ebfefa3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.013829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96c35-9746-4c18-8d2f-b91c2ebfefa3 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.016012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 189/381] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:40.022717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7032e-b19a-4788-9db5-a51bbdbf4905 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.023017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7032e-b19a-4788-9db5-a51bbdbf4905 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.023269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7032e-b19a-4788-9db5-a51bbdbf4905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.042115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-93f7032e-b19a-4788-9db5-a51bbdbf4905 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:40.043459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-93f7032e-b19a-4788-9db5-a51bbdbf4905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:40.052494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 193/382] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:40.078537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96c35-9746-4c18-8d2f-b91c2ebfefa3 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.091427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96c35-9746-4c18-8d2f-b91c2ebfefa3 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.096394 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889cbf8-ea3e-4434-b78b-6d49ebb87b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.097266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889cbf8-ea3e-4434-b78b-6d49ebb87b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.097570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889cbf8-ea3e-4434-b78b-6d49ebb87b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.097839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889cbf8-ea3e-4434-b78b-6d49ebb87b5d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.111068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889cbf8-ea3e-4434-b78b-6d49ebb87b5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:40.121127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-5889cbf8-ea3e-4434-b78b-6d49ebb87b5d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:40.121127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 190/383] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:40.126897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7032e-b19a-4788-9db5-a51bbdbf4905 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.136945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7032e-b19a-4788-9db5-a51bbdbf4905 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.141685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.142424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.142738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.143043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.144460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:40.144821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.146571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.157774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 194/384] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:40.167275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889cbf8-ea3e-4434-b78b-6d49ebb87b5d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.179532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889cbf8-ea3e-4434-b78b-6d49ebb87b5d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.185656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c3f4f-8c26-4516-81d3-b6b4901a7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.186329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3f4f-8c26-4516-81d3-b6b4901a7b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.187259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3f4f-8c26-4516-81d3-b6b4901a7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.187259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3f4f-8c26-4516-81d3-b6b4901a7b08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.196900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c3f4f-8c26-4516-81d3-b6b4901a7b08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.198788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c3f4f-8c26-4516-81d3-b6b4901a7b08 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.210774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 191/385] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:40.217156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.228378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf384-4fb7-4450-88d7-0508a07aad16 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.234129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa373b-f597-4b95-9711-5183b7f36165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.235035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa373b-f597-4b95-9711-5183b7f36165 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.235318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa373b-f597-4b95-9711-5183b7f36165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.235589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa373b-f597-4b95-9711-5183b7f36165 admin admin] PATH_INFO: `/v3/projects/a62f9c4d0b7f4443a8eb78e076640010` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.236801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa373b-f597-4b95-9711-5183b7f36165 admin admin] RBAC: Authorizing `identity:get_project(project_id=a62f9c4d0b7f4443a8eb78e076640010)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.238735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa373b-f597-4b95-9711-5183b7f36165 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.240968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 195/386] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/projects/a62f9c4d0b7f4443a8eb78e076640010 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:40.247030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c3f4f-8c26-4516-81d3-b6b4901a7b08 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.256936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c3f4f-8c26-4516-81d3-b6b4901a7b08 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.262416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f04498-472b-4a65-8f76-0d77e4cbb216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.263542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f04498-472b-4a65-8f76-0d77e4cbb216 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.264013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f04498-472b-4a65-8f76-0d77e4cbb216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.264452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f04498-472b-4a65-8f76-0d77e4cbb216 admin admin] PATH_INFO: `/v3/groups/cad95c2837284f2aa3945b17cc1aac29` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.265762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f04498-472b-4a65-8f76-0d77e4cbb216 admin admin] RBAC: Authorizing `identity:get_group(group_id=cad95c2837284f2aa3945b17cc1aac29)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.267851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f04498-472b-4a65-8f76-0d77e4cbb216 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.270089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 192/387] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/groups/cad95c2837284f2aa3945b17cc1aac29 => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:40.276729 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa373b-f597-4b95-9711-5183b7f36165 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.287647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa373b-f597-4b95-9711-5183b7f36165 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.292179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ba819-9113-4da6-8aaa-82f3e669afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.292884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ba819-9113-4da6-8aaa-82f3e669afdf admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.293237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ba819-9113-4da6-8aaa-82f3e669afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.294047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ba819-9113-4da6-8aaa-82f3e669afdf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.294401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ba819-9113-4da6-8aaa-82f3e669afdf admin admin] RBAC: Adding query filter params (group.id=cad95c2837284f2aa3945b17cc1aac29, role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=a62f9c4d0b7f4443a8eb78e076640010) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:40.294736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ba819-9113-4da6-8aaa-82f3e669afdf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.296616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ba819-9113-4da6-8aaa-82f3e669afdf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.304088 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 196/388] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/role_assignments?group.id=cad95c2837284f2aa3945b17cc1aac29&scope.project.id=a62f9c4d0b7f4443a8eb78e076640010&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:40.515182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06325-4075-429a-b07f-5a1958f2ca67 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.515482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06325-4075-429a-b07f-5a1958f2ca67 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.515836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba06325-4075-429a-b07f-5a1958f2ca67 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.517604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 193/389] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:40.524325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae12a-30f0-4251-ae6d-7841bc0af60c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.524610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae12a-30f0-4251-ae6d-7841bc0af60c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.524885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae12a-30f0-4251-ae6d-7841bc0af60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.543194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-876ae12a-30f0-4251-ae6d-7841bc0af60c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:40.544377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-876ae12a-30f0-4251-ae6d-7841bc0af60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:40.552217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 197/390] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:40.578155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba06325-4075-429a-b07f-5a1958f2ca67 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.590568 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba06325-4075-429a-b07f-5a1958f2ca67 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.594624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7f95-4789-43ec-a4d6-16bc3e821d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.595406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7f95-4789-43ec-a4d6-16bc3e821d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.595679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7f95-4789-43ec-a4d6-16bc3e821d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.595945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7f95-4789-43ec-a4d6-16bc3e821d44 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.605690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7f95-4789-43ec-a4d6-16bc3e821d44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:40.613007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-830f7f95-4789-43ec-a4d6-16bc3e821d44 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:40.614385 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 194/391] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:40.620716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae12a-30f0-4251-ae6d-7841bc0af60c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.629986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae12a-30f0-4251-ae6d-7841bc0af60c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.634234 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.634902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.635177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.635443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.636185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:40.636484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.638075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.646429 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 198/392] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:40.652404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7f95-4789-43ec-a4d6-16bc3e821d44 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.661747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7f95-4789-43ec-a4d6-16bc3e821d44 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.665953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d919c6f-6c5e-4f93-99f9-b70253888ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.666614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d919c6f-6c5e-4f93-99f9-b70253888ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.666892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d919c6f-6c5e-4f93-99f9-b70253888ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.667163 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d919c6f-6c5e-4f93-99f9-b70253888ec8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.675349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d919c6f-6c5e-4f93-99f9-b70253888ec8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.677083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d919c6f-6c5e-4f93-99f9-b70253888ec8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.685484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 195/393] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:40.692112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.701390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc90ad-bdff-42b0-a990-e38f018a8caa admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.705593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e09a6-4eff-4dce-9b89-b9b580eecc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.706978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e09a6-4eff-4dce-9b89-b9b580eecc3a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.707251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e09a6-4eff-4dce-9b89-b9b580eecc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.707516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e09a6-4eff-4dce-9b89-b9b580eecc3a admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.708673 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e09a6-4eff-4dce-9b89-b9b580eecc3a admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.710723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e09a6-4eff-4dce-9b89-b9b580eecc3a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.712311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 199/394] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:40.717977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d919c6f-6c5e-4f93-99f9-b70253888ec8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.726805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d919c6f-6c5e-4f93-99f9-b70253888ec8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.731011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74167b4e-bfae-4645-a7b1-277bb1f7850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.731839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167b4e-bfae-4645-a7b1-277bb1f7850f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.732111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167b4e-bfae-4645-a7b1-277bb1f7850f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.732380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167b4e-bfae-4645-a7b1-277bb1f7850f admin admin] PATH_INFO: `/v3/groups/a0fd33ba177345f2b98a28f061b998c4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.733508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74167b4e-bfae-4645-a7b1-277bb1f7850f admin admin] RBAC: Authorizing `identity:get_group(group_id=a0fd33ba177345f2b98a28f061b998c4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.735418 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74167b4e-bfae-4645-a7b1-277bb1f7850f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.737438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 196/395] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/groups/a0fd33ba177345f2b98a28f061b998c4 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:40.743918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e09a6-4eff-4dce-9b89-b9b580eecc3a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:40.753875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e09a6-4eff-4dce-9b89-b9b580eecc3a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:40.758107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59362794-95d5-4d3c-92e9-a48def5ea90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:40.758755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362794-95d5-4d3c-92e9-a48def5ea90d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:40.759034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362794-95d5-4d3c-92e9-a48def5ea90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:40.759302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362794-95d5-4d3c-92e9-a48def5ea90d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:40.760114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59362794-95d5-4d3c-92e9-a48def5ea90d admin admin] RBAC: Adding query filter params (group.id=a0fd33ba177345f2b98a28f061b998c4, role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=a4565572e31b4ffe8a733d9183cd77c5) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:40.760415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59362794-95d5-4d3c-92e9-a48def5ea90d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:40.762260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59362794-95d5-4d3c-92e9-a48def5ea90d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:40.767949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 200/396] 10.222.0.16 () {56 vars in 1397 bytes} [Thu Nov 11 16:55:40 2021] GET /identity/v3/role_assignments?group.id=a0fd33ba177345f2b98a28f061b998c4&scope.project.id=a4565572e31b4ffe8a733d9183cd77c5&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:43.852585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147884-a7ca-438f-9ee0-b3a318cd1061 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:43.853133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147884-a7ca-438f-9ee0-b3a318cd1061 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:43.853133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147884-a7ca-438f-9ee0-b3a318cd1061 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:43.855221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 197/397] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:43.860858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6d53-3462-4c2d-8b0b-e430f67b75bd None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:43.861640 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6d53-3462-4c2d-8b0b-e430f67b75bd None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:43.862180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6d53-3462-4c2d-8b0b-e430f67b75bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:43.887812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-295a6d53-3462-4c2d-8b0b-e430f67b75bd None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:43.889301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-295a6d53-3462-4c2d-8b0b-e430f67b75bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:43.898382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 201/398] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:43.922924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51de521-9d7a-42b4-abc2-e81759942d3b None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:43.923206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51de521-9d7a-42b4-abc2-e81759942d3b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:43.923480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51de521-9d7a-42b4-abc2-e81759942d3b None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:43.925575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 198/399] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:43.928679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952c8e-9689-4a4e-87ef-fe245114d6c0 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:43.929184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952c8e-9689-4a4e-87ef-fe245114d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:43.929684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a952c8e-9689-4a4e-87ef-fe245114d6c0 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:43.930863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0b47-3316-4bc3-b0a8-dccb6c1117ac None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:43.931385 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0b47-3316-4bc3-b0a8-dccb6c1117ac None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:43.931922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0b47-3316-4bc3-b0a8-dccb6c1117ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:43.932028 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 202/400] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:43.937901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0ca1-d3ec-4a81-9e19-d8fa2854cd2a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:43.938175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0ca1-d3ec-4a81-9e19-d8fa2854cd2a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:43.938454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0ca1-d3ec-4a81-9e19-d8fa2854cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:43.953419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-faea0b47-3316-4bc3-b0a8-dccb6c1117ac None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:43.954938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-faea0b47-3316-4bc3-b0a8-dccb6c1117ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:43.958232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-1c3a0ca1-d3ec-4a81-9e19-d8fa2854cd2a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:43.959493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1c3a0ca1-d3ec-4a81-9e19-d8fa2854cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:43.964506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 199/401] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:43.970672 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea0b47-3316-4bc3-b0a8-dccb6c1117ac None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:43.974686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 203/402] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:43.979571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea0b47-3316-4bc3-b0a8-dccb6c1117ac None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:43.984043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:43.984833 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:43.985112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:43.985386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.007578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.009459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.011087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a0ca1-d3ec-4a81-9e19-d8fa2854cd2a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.028648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:44.029054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a0ca1-d3ec-4a81-9e19-d8fa2854cd2a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.030149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:44.035457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.040123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.040935 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.041212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.041730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.046262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff42a-a204-493d-bb23-f32a39e727fc admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.050906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.051688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.051970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.052244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.054616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.057006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.062792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.064655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.078432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:44.080038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 204/404] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:44.085871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.089662 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:44.093995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 201/405] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:44.095396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.100992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb5633-a458-40f8-aaf1-c1f1070a9304 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.105711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.106303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.106618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.106893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.107625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:44.107926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.108932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:44.108932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:44.108932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:44.109446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9481c6b-7fd0-4869-aa69-3bb83b5178fe admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.109809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.114464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.115393 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.115864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.116346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.117263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:44.117756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.119545 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.128867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 205/406] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:44.129601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.132418 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 202/407] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:44.138247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.139713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22a60c-b216-43dd-bfc5-131b9f1db964 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.144740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.145391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.145679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.145951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.146747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:44.147394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.148666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.151050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934dbfd-ab8a-4aee-8553-f5b19f93b778 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.156029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b092918-8d4b-4bc2-bf20-1c5584cc81ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.159829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092918-8d4b-4bc2-bf20-1c5584cc81ab admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.160490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092918-8d4b-4bc2-bf20-1c5584cc81ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.161089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 206/408] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:44.161420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092918-8d4b-4bc2-bf20-1c5584cc81ab admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.162335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b092918-8d4b-4bc2-bf20-1c5584cc81ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.164966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b092918-8d4b-4bc2-bf20-1c5584cc81ab admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.166088 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.177226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ad6e8-cc3f-4f70-8f7c-ac4ae3273c2f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.181748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c5e51-5134-4b40-b351-dbc215c3160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.182409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5e51-5134-4b40-b351-dbc215c3160e admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.182730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5e51-5134-4b40-b351-dbc215c3160e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.183007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5e51-5134-4b40-b351-dbc215c3160e admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.183719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c5e51-5134-4b40-b351-dbc215c3160e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.185620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c5e51-5134-4b40-b351-dbc215c3160e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.289113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 203/409] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:44 2021] POST /identity/v3/users => generated 248 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:44.290857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b092918-8d4b-4bc2-bf20-1c5584cc81ab admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.306217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b092918-8d4b-4bc2-bf20-1c5584cc81ab admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.311772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a9051-d987-4cf2-b29a-f7d62bc97ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.312937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a9051-d987-4cf2-b29a-f7d62bc97ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.313502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a9051-d987-4cf2-b29a-f7d62bc97ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.313988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a9051-d987-4cf2-b29a-f7d62bc97ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.315162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a9051-d987-4cf2-b29a-f7d62bc97ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.317650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a9051-d987-4cf2-b29a-f7d62bc97ad8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.332023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 207/410] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:44 2021] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:44.432818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 204/411] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:44 2021] POST /identity/v3/users => generated 248 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:44.533394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698fc7-52b1-43b9-af0a-17f9e999954e None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.534733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698fc7-52b1-43b9-af0a-17f9e999954e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.535237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698fc7-52b1-43b9-af0a-17f9e999954e None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.537840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 208/412] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:44.545304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427661-3a7e-4b60-a53b-4e7cd59edae3 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.545968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427661-3a7e-4b60-a53b-4e7cd59edae3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.546456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427661-3a7e-4b60-a53b-4e7cd59edae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.567742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ef427661-3a7e-4b60-a53b-4e7cd59edae3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:44.569603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ef427661-3a7e-4b60-a53b-4e7cd59edae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:44.584206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 205/413] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:44.609397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f698fc7-52b1-43b9-af0a-17f9e999954e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.623003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f698fc7-52b1-43b9-af0a-17f9e999954e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.628244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.629425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.629910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.630385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.642962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.645716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.666162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:44.667782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 209/414] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:44.675603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427661-3a7e-4b60-a53b-4e7cd59edae3 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.689122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427661-3a7e-4b60-a53b-4e7cd59edae3 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.697233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860aff9-78d4-40e3-9062-dfd310350e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.698165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860aff9-78d4-40e3-9062-dfd310350e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.698672 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860aff9-78d4-40e3-9062-dfd310350e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.699094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860aff9-78d4-40e3-9062-dfd310350e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.700012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860aff9-78d4-40e3-9062-dfd310350e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:44.700463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860aff9-78d4-40e3-9062-dfd310350e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.702256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860aff9-78d4-40e3-9062-dfd310350e83 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.717560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 206/415] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:44.723640 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:44.736492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401a436-f091-477b-bc2e-6d44c2231c24 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:44.743222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d31599-5635-49a9-aad9-763a27a3c3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:44.744135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31599-5635-49a9-aad9-763a27a3c3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:44.744574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31599-5635-49a9-aad9-763a27a3c3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:44.744944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31599-5635-49a9-aad9-763a27a3c3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:44.745793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d31599-5635-49a9-aad9-763a27a3c3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:44.748090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d31599-5635-49a9-aad9-763a27a3c3d8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:44.831567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 210/416] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:44 2021] POST /identity/v3/users => generated 249 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:45.075627 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c05e4-cfe9-4be4-866f-b4c76d53fc7e None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:45.076473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c05e4-cfe9-4be4-866f-b4c76d53fc7e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:45.079951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c05e4-cfe9-4be4-866f-b4c76d53fc7e None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:45.079951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 207/417] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:45.085433 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbee8e-d619-4261-8475-1d2151758ae4 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:45.086248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbee8e-d619-4261-8475-1d2151758ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:45.086710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbee8e-d619-4261-8475-1d2151758ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:45.117878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b7bbee8e-d619-4261-8475-1d2151758ae4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:45.119417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b7bbee8e-d619-4261-8475-1d2151758ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:45.129116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 211/418] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:45.152213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c05e4-cfe9-4be4-866f-b4c76d53fc7e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:45.165784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c05e4-cfe9-4be4-866f-b4c76d53fc7e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:45.170221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:45.170953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:45.171237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:45.171509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:45.172268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:45.173849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:45.207284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.sql.core [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 11 16:55:45.207284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 11 16:55:45.207284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [parameters: {'id': 'ef9f0ad5ee414ae5ab35650d21a55e3e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 11 16:55:45.207284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79381) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 11 16:55:45.222202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 11 16:55:45.224740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 208/419] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 16:55:45 2021] POST /identity/v3/roles => generated 144 bytes in 73 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:45.232774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbee8e-d619-4261-8475-1d2151758ae4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:45.245964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbee8e-d619-4261-8475-1d2151758ae4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:45.252983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa02d22-a65b-4a03-b467-e8a290ec612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:45.253839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa02d22-a65b-4a03-b467-e8a290ec612b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:45.254128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa02d22-a65b-4a03-b467-e8a290ec612b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:45.254393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa02d22-a65b-4a03-b467-e8a290ec612b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:45.271094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa02d22-a65b-4a03-b467-e8a290ec612b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:45.278804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-faa02d22-a65b-4a03-b467-e8a290ec612b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 11 16:55:45.280363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 212/420] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:55:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:45.287055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:45.301398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ba61-9fdc-4443-af54-0c9dfe27e05d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:45.310641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ca538-9d9a-4f43-9de9-3eb22c1b2714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:45.311310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ca538-9d9a-4f43-9de9-3eb22c1b2714 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:45.311589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ca538-9d9a-4f43-9de9-3eb22c1b2714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:45.311863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ca538-9d9a-4f43-9de9-3eb22c1b2714 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:45.312715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ca538-9d9a-4f43-9de9-3eb22c1b2714 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:45.313022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ca538-9d9a-4f43-9de9-3eb22c1b2714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:45.314733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ca538-9d9a-4f43-9de9-3eb22c1b2714 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:45.323811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 209/421] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.203514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a62ca-994a-4c64-9cd3-8d9c1df2d575 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.204024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a62ca-994a-4c64-9cd3-8d9c1df2d575 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.204101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a62ca-994a-4c64-9cd3-8d9c1df2d575 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.206788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 213/422] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:47.213299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd56e-ee29-4ecf-9b01-85e11fb2a287 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.213806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd56e-ee29-4ecf-9b01-85e11fb2a287 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.213881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd56e-ee29-4ecf-9b01-85e11fb2a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.239481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7e6bd56e-ee29-4ecf-9b01-85e11fb2a287 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:47.240738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7e6bd56e-ee29-4ecf-9b01-85e11fb2a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:47.254030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 210/423] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:47.298830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a62ca-994a-4c64-9cd3-8d9c1df2d575 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.315734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a62ca-994a-4c64-9cd3-8d9c1df2d575 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.326166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99997e37-d0dc-4e01-8c57-6cd59ecd8d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.326999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997e37-d0dc-4e01-8c57-6cd59ecd8d3e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.327276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997e37-d0dc-4e01-8c57-6cd59ecd8d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.327549 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997e37-d0dc-4e01-8c57-6cd59ecd8d3e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.343849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99997e37-d0dc-4e01-8c57-6cd59ecd8d3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:47.346128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981866-b488-4653-90f1-8b3503ce9a31 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.346452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981866-b488-4653-90f1-8b3503ce9a31 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.346753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981866-b488-4653-90f1-8b3503ce9a31 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.348520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 211/424] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:47.354391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aeb4-74f8-41d2-9e2e-16d7cdedfd07 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.354694 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aeb4-74f8-41d2-9e2e-16d7cdedfd07 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.354965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155aeb4-74f8-41d2-9e2e-16d7cdedfd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.355131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-99997e37-d0dc-4e01-8c57-6cd59ecd8d3e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:47.356510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 214/425] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.362618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99997e37-d0dc-4e01-8c57-6cd59ecd8d3e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.372536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99997e37-d0dc-4e01-8c57-6cd59ecd8d3e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.377100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd52f6-102a-4f7a-812b-0b2b8f0174ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.378259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd52f6-102a-4f7a-812b-0b2b8f0174ad admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.378574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd52f6-102a-4f7a-812b-0b2b8f0174ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.380222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd52f6-102a-4f7a-812b-0b2b8f0174ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.380222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd52f6-102a-4f7a-812b-0b2b8f0174ad admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.380222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd52f6-102a-4f7a-812b-0b2b8f0174ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.381655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd52f6-102a-4f7a-812b-0b2b8f0174ad admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.389764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4155aeb4-74f8-41d2-9e2e-16d7cdedfd07 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:47.391361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4155aeb4-74f8-41d2-9e2e-16d7cdedfd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:47.394444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 215/426] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:47.396631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c627-862e-41e5-aed5-dce956ca917a None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.396917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c627-862e-41e5-aed5-dce956ca917a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.397191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c627-862e-41e5-aed5-dce956ca917a None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.398975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 216/427] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:47.399657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331c627-862e-41e5-aed5-dce956ca917a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.405846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 212/428] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:47.407496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf7fcf-6419-4de6-aef3-702ca659c242 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.408004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf7fcf-6419-4de6-aef3-702ca659c242 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.408486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf7fcf-6419-4de6-aef3-702ca659c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.431391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331c627-862e-41e5-aed5-dce956ca917a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.434276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4bbf7fcf-6419-4de6-aef3-702ca659c242 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:47.435569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4bbf7fcf-6419-4de6-aef3-702ca659c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:47.436709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.437850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.438356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.438924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.443944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 213/429] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:47.444873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf7fcf-6419-4de6-aef3-702ca659c242 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.452442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.454587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.464954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf7fcf-6419-4de6-aef3-702ca659c242 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.473676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:47.475137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 217/430] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.479566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0723-5c1b-49e8-899d-7bb3db242ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.479566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0723-5c1b-49e8-899d-7bb3db242ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.479566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0723-5c1b-49e8-899d-7bb3db242ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.479566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0723-5c1b-49e8-899d-7bb3db242ff1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.480732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.493596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e153f-dbd5-44bd-a3c1-b5d25ebd3fdf admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.494884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf0723-5c1b-49e8-899d-7bb3db242ff1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:47.498337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0866a-397a-47c3-8efa-8bb3b61ba2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.499283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0866a-397a-47c3-8efa-8bb3b61ba2ba admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.499858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0866a-397a-47c3-8efa-8bb3b61ba2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.500322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0866a-397a-47c3-8efa-8bb3b61ba2ba admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.503633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-eecf0723-5c1b-49e8-899d-7bb3db242ff1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:47.505414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 214/431] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.506474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0723-5c1b-49e8-899d-7bb3db242ff1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.513238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0866a-397a-47c3-8efa-8bb3b61ba2ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:47.516720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0723-5c1b-49e8-899d-7bb3db242ff1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.520558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-37e0866a-397a-47c3-8efa-8bb3b61ba2ba admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:47.526579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 218/432] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:47.526579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0866a-397a-47c3-8efa-8bb3b61ba2ba admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.526761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.527510 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.527682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.528167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.528729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.529035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.530676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.542982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0866a-397a-47c3-8efa-8bb3b61ba2ba admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.544521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 215/433] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.545146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.548728 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.549668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.550216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.550918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.551886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.552400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.554215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.560483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6006f57-e9e5-4c71-8b43-41192b904871 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.565711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 219/434] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.566941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.570875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.571561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.571847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.572124 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.572892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.573197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.575627 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.579487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7918ec-a779-4c22-83c5-e2fe4d9cf377 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.589754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 216/435] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.589754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.589948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.589948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.589948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.589948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.607763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.610225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.616176 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c8fe7-9332-4ec7-875c-a1289a33ccbf admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.624768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.625575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.625859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.626136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.629827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 11 16:55:47.631681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 220/436] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.632699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.643107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.645142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ba603-88a8-4e91-9b87-6a1cf19f9588 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.645536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.650719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.651766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.652667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.653150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.663717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:47.665178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 217/437] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.665764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.666937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.669112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.680473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92065-2b7a-4719-a77d-a294e2a391ba admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.685202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.685853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.686139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.686415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.687410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.687723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.688814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:47.688814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:55:47.688814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:55:47.690707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.693448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:47.700563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 221/438] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.701925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.714988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fbb6b-06a4-43ee-8681-5b2ee88aec5d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.719909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.721795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.722314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.722840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.723865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.724365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.726199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.732789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 218/439] 10.222.0.16 () {56 vars in 1158 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.733642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.741689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 222/440] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.742933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.756059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927eb14-0303-48dc-ae2f-9c3fbfe8b449 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.756258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe876cb-926a-4702-a7f5-07912ffd1b27 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.761058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.761839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.762084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.762415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.763117 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb49a3a-84ed-4537-bf59-a565890f92f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.763263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.763572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.764604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49a3a-84ed-4537-bf59-a565890f92f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.765105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49a3a-84ed-4537-bf59-a565890f92f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.765355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.765782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49a3a-84ed-4537-bf59-a565890f92f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.777619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb49a3a-84ed-4537-bf59-a565890f92f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.784117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 219/441] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.784117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.784363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb49a3a-84ed-4537-bf59-a565890f92f7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.794740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162acf-9491-4702-a07b-beced6f641ad admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.797638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 223/442] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:47.798783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb49a3a-84ed-4537-bf59-a565890f92f7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.805174 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.806401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.806401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.806697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.811268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb49a3a-84ed-4537-bf59-a565890f92f7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.814573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.817152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.817832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.819117 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.820134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.820697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.830009 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.830648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:55:47.832063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 220/443] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.832665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.833630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.847729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecbfd9-a7ad-4712-9e68-304bbed268d2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.851756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 11 16:55:47.852326 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.853106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.853442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.853716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.854066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 224/444] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/users/glance => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.855342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.866344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.868073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717c15-4d53-461d-bb45-fc1ede24ad6c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.868420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.873574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.874517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.875012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.876007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.877450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.877981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.879545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:47.879545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:47.879545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:47.881022 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.886171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:47.887583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 221/445] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:47.893513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.904000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02d02d-0f34-43ac-82bc-3eb35e1e88fb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.908529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d49e8-22b8-49ea-aa76-8ef9b9c840bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.909719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d49e8-22b8-49ea-aa76-8ef9b9c840bb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.910366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d49e8-22b8-49ea-aa76-8ef9b9c840bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.910366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d49e8-22b8-49ea-aa76-8ef9b9c840bb admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.911191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d49e8-22b8-49ea-aa76-8ef9b9c840bb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.911499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d49e8-22b8-49ea-aa76-8ef9b9c840bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.913373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d49e8-22b8-49ea-aa76-8ef9b9c840bb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.925134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 225/446] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.925820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.935451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 222/447] 10.222.0.16 () {56 vars in 1158 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.936560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48374f89-e659-46b4-ba00-819719b96ef7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.937364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a37c04-745a-42b5-b367-f4e028f7bfde None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.937849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a37c04-745a-42b5-b367-f4e028f7bfde None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.938449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a37c04-745a-42b5-b367-f4e028f7bfde None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.940668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 223/448] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:47.945478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.945478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.945478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.945478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.945766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a37c04-745a-42b5-b367-f4e028f7bfde None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.945835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:47.945835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.946182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.955143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a37c04-745a-42b5-b367-f4e028f7bfde None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.957787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 226/449] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:47.958714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:47.964369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acdfd3-fd38-499b-969c-ff8dac00aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.965041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acdfd3-fd38-499b-969c-ff8dac00aeef admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.965319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acdfd3-fd38-499b-969c-ff8dac00aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.965590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acdfd3-fd38-499b-969c-ff8dac00aeef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.968688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0145d-9ca9-4775-b0bf-0c48651ad6c7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:47.973596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f5ba-a32d-4829-b875-32b856bb0847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:47.974157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acdfd3-fd38-499b-969c-ff8dac00aeef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.974261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f5ba-a32d-4829-b875-32b856bb0847 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.974489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f5ba-a32d-4829-b875-32b856bb0847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.974787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f5ba-a32d-4829-b875-32b856bb0847 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.975951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acdfd3-fd38-499b-969c-ff8dac00aeef admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.982692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687f5ba-a32d-4829-b875-32b856bb0847 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:47.984432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687f5ba-a32d-4829-b875-32b856bb0847 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:47.984790 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 224/450] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:47.990826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7647fc8-2ffe-400e-b9d7-3f09ecd57794 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:47.990826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7647fc8-2ffe-400e-b9d7-3f09ecd57794 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:47.990826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7647fc8-2ffe-400e-b9d7-3f09ecd57794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:47.996659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 227/451] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:47.998731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f5ba-a32d-4829-b875-32b856bb0847 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.007196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c7647fc8-2ffe-400e-b9d7-3f09ecd57794 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:48.007878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f5ba-a32d-4829-b875-32b856bb0847 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.008381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c7647fc8-2ffe-400e-b9d7-3f09ecd57794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:48.012312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.013174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.013543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.013959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.016158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 225/452] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:48.017070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7647fc8-2ffe-400e-b9d7-3f09ecd57794 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.024692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.026480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7647fc8-2ffe-400e-b9d7-3f09ecd57794 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.027059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.031268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.032150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.032426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.032695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.044371 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.045542 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:48.046202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.047116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 228/453] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:48.047741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.058841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e0815-7e39-449c-a901-55c41e836401 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.063221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.063991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.064095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:48.064298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.064539 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.065432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 226/454] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:48.066077 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.076529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.078362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.079139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2814ca-6464-460e-8000-ebf4c67dd2b0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.083723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ac0b0-c5df-47fd-9243-d9bc0f2214e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.084478 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ac0b0-c5df-47fd-9243-d9bc0f2214e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.084764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ac0b0-c5df-47fd-9243-d9bc0f2214e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.085053 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ac0b0-c5df-47fd-9243-d9bc0f2214e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.095058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ac0b0-c5df-47fd-9243-d9bc0f2214e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:48.095578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:48.102637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 229/455] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:48.102637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.102853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-635ac0b0-c5df-47fd-9243-d9bc0f2214e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:48.107433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 227/456] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:48.107433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ac0b0-c5df-47fd-9243-d9bc0f2214e5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.117130 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fd33-12c6-45c1-8a3d-2fd33ad10a2e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.117489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ac0b0-c5df-47fd-9243-d9bc0f2214e5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.121689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.121834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.122342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.122434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.122648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.122815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.122906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.123220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.123623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.123923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.124189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.124562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.125514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.125649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:48.125649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:48.125649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:48.126992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.136823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 228/457] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.137450 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.146946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820ae7-8fea-4940-977b-9ef3ecff3f8b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.148179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 230/458] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.149261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.157785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.160187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.160572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.160925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.161844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.162194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.163537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0be4-b127-43e0-a0c7-a7992ff14491 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.163962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.168591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.169277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.169553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.169820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.170610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.170913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.172607 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.178212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 229/459] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.179591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.186888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 231/460] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.187995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.189593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9cb20-ee59-4484-acc2-110a59b3245c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.199730 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.200534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.200634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156efcd-204e-4f72-ac9b-577ffa910788 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.200824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.201145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.204841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.205478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.205773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.206064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.206948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=b88bc12e78894bdbaf79d148c3dd2e2a) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.207246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.208392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.209094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.210665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.214863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 232/461] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/role_assignments?user.id=b88bc12e78894bdbaf79d148c3dd2e2a&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.215821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.226459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac933c31-6a67-4097-aa45-b5f03bbdf6e0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.231804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.232040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:48.233440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.233940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.234406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.238735 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 230/462] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:48.240323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.245895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.247957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.252591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769327a-fefd-4158-9692-15c7ee3e7cff admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.257989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.259160 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.259610 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.260068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.264150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:48.271455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 233/463] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:48.272375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.272493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.274600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.289198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4f0a2-bbeb-4f37-a02b-0c764f1cff8b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.294422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.294972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:48.295637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.296088 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.296587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.297594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.298161 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.300581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.301602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 231/464] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:48.302571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.312980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e6aaf-2ce7-4708-9306-dacd8eb818f0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.321344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 234/465] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.321344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.324189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.325007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.325289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.325569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.326367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.326571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8def2-47af-4c83-aac8-dc31a7910a28 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.326729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.327859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:48.327859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:55:48.327859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:55:48.329120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.331713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c0a5f-e6b3-4583-84ae-f29fcebc4910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.332384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0a5f-e6b3-4583-84ae-f29fcebc4910 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.332667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0a5f-e6b3-4583-84ae-f29fcebc4910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.332947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0a5f-e6b3-4583-84ae-f29fcebc4910 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.333684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0a5f-e6b3-4583-84ae-f29fcebc4910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.333991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0a5f-e6b3-4583-84ae-f29fcebc4910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.335639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0a5f-e6b3-4583-84ae-f29fcebc4910 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.358400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 235/466] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.358400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72760-26bb-4d13-b7bc-f1423333f268 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.358400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72760-26bb-4d13-b7bc-f1423333f268 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.358400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72760-26bb-4d13-b7bc-f1423333f268 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.358794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 232/467] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.358868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 236/468] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:48.358968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.359893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72760-26bb-4d13-b7bc-f1423333f268 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.368354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0b1e-c5ca-4643-b4b4-23d4769d5a8b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.372599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72760-26bb-4d13-b7bc-f1423333f268 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.373108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fe465-8c9f-457e-a9f9-3ace4736f35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.373770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fe465-8c9f-457e-a9f9-3ace4736f35e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.374054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fe465-8c9f-457e-a9f9-3ace4736f35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.374332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fe465-8c9f-457e-a9f9-3ace4736f35e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.375237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fe465-8c9f-457e-a9f9-3ace4736f35e admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=0941777cfcbf4532be31ca001ced8aa7) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.375537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fe465-8c9f-457e-a9f9-3ace4736f35e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.377419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fe465-8c9f-457e-a9f9-3ace4736f35e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.377545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.378495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.379122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.379684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.380648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=8a061423c1f646b8892d646979f84f20) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.380955 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.383000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.384147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 233/469] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/role_assignments?user.id=0941777cfcbf4532be31ca001ced8aa7&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.385284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208c9f-41df-47cf-8b31-1fcc90065d73 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.385570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208c9f-41df-47cf-8b31-1fcc90065d73 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.385844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94208c9f-41df-47cf-8b31-1fcc90065d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.411979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 237/470] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/role_assignments?user.id=8a061423c1f646b8892d646979f84f20&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.412908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.414297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-94208c9f-41df-47cf-8b31-1fcc90065d73 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:48.418686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-94208c9f-41df-47cf-8b31-1fcc90065d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:48.432915 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966d02-b029-48e1-b710-92902407f408 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.442863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 234/471] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:48.456624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.457506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.457800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.458071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.476186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.479785 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.491468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94208c9f-41df-47cf-8b31-1fcc90065d73 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.504137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94208c9f-41df-47cf-8b31-1fcc90065d73 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.511680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.512556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.512837 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.513107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.519233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 11 16:55:48.520985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 238/472] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/users/neutron => generated 85 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:48.525766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.527848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.529654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.542144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eb098-dc00-4f6e-8e13-3e3333e8642f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.546655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.547316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.547591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.547863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.548806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.549111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.549595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:48.551068 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.551320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 235/473] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:48.561563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.578407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 239/474] 10.222.0.16 () {56 vars in 1160 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.585006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19117153-fee1-4d44-bef7-21f2cd3b0e20 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.586216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.599214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.600106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.600668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.601217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.603968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.604275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.605765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9ac6c-065f-4635-9f10-1c2aace97c98 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.607915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.618011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3edd75-38e4-448a-9f52-8cb36bf6c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.618745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3edd75-38e4-448a-9f52-8cb36bf6c23f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.619025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3edd75-38e4-448a-9f52-8cb36bf6c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.619294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3edd75-38e4-448a-9f52-8cb36bf6c23f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.635697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 236/475] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.635992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3edd75-38e4-448a-9f52-8cb36bf6c23f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.637503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3edd75-38e4-448a-9f52-8cb36bf6c23f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.647191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.654658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 240/476] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:48.659766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb449-0715-4f2e-b994-44e7f1249781 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.660817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3edd75-38e4-448a-9f52-8cb36bf6c23f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.665994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041a547-21ca-42c5-9a65-5359d8adbd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.666707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041a547-21ca-42c5-9a65-5359d8adbd7b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.666989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041a547-21ca-42c5-9a65-5359d8adbd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.667261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041a547-21ca-42c5-9a65-5359d8adbd7b admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.667992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041a547-21ca-42c5-9a65-5359d8adbd7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.669955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041a547-21ca-42c5-9a65-5359d8adbd7b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.671261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3edd75-38e4-448a-9f52-8cb36bf6c23f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.677330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.677330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.677330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.677900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.689221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.691980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.712004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:48.713593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 241/477] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:48.719598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.730003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5211f5-d34c-4929-bf86-be0d9823a8be admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.734482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.735225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.735541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.735816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.736579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.736882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.738616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.751053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 242/478] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:48.757765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.771263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d51f8-765b-4912-8421-7f7049afbf0a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.783633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.785594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.785872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.786968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.787822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 237/479] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:48 2021] POST /identity/v3/users => generated 247 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:48.801095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.803243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.820380 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:48.822097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 243/480] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:48.828726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041a547-21ca-42c5-9a65-5359d8adbd7b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.844416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041a547-21ca-42c5-9a65-5359d8adbd7b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.860322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651d9ae-8ac8-4c51-bbb5-7299de66e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.861002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d9ae-8ac8-4c51-bbb5-7299de66e531 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.861281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d9ae-8ac8-4c51-bbb5-7299de66e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.861639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d9ae-8ac8-4c51-bbb5-7299de66e531 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.862474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651d9ae-8ac8-4c51-bbb5-7299de66e531 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.862819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651d9ae-8ac8-4c51-bbb5-7299de66e531 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.864955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651d9ae-8ac8-4c51-bbb5-7299de66e531 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.888361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 238/481] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:48.895456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:48.909157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d5ca2-9e1d-453c-8a2a-1240d8815e27 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:48.920356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a9639-91c2-4c78-a12c-1f93e3f9c503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:48.921048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a9639-91c2-4c78-a12c-1f93e3f9c503 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:48.921382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a9639-91c2-4c78-a12c-1f93e3f9c503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:48.921652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a9639-91c2-4c78-a12c-1f93e3f9c503 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:48.922497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a9639-91c2-4c78-a12c-1f93e3f9c503 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=872474833e2f49c9a9ceccef8914e2b8) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:48.922826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a9639-91c2-4c78-a12c-1f93e3f9c503 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:48.924832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a9639-91c2-4c78-a12c-1f93e3f9c503 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:48.935224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 244/482] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:48 2021] GET /identity/v3/role_assignments?user.id=872474833e2f49c9a9ceccef8914e2b8&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:50.944899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1095a4-5c63-463a-a418-f017e364d56f None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:50.945423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1095a4-5c63-463a-a418-f017e364d56f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:50.945423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1095a4-5c63-463a-a418-f017e364d56f None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:50.947373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 239/483] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:50.953470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a77821-a4fd-4f3c-9a10-d2ffd6b63e7a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:50.953895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a77821-a4fd-4f3c-9a10-d2ffd6b63e7a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:50.954073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a77821-a4fd-4f3c-9a10-d2ffd6b63e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:50.979538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c3a77821-a4fd-4f3c-9a10-d2ffd6b63e7a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:50.980750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c3a77821-a4fd-4f3c-9a10-d2ffd6b63e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:50.989272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 245/484] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:51.025181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1095a4-5c63-463a-a418-f017e364d56f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.040494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1095a4-5c63-463a-a418-f017e364d56f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.048395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619203c-9ee0-42ae-bcd6-381e21677569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.049228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619203c-9ee0-42ae-bcd6-381e21677569 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.049552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619203c-9ee0-42ae-bcd6-381e21677569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.049829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619203c-9ee0-42ae-bcd6-381e21677569 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.066187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619203c-9ee0-42ae-bcd6-381e21677569 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:51.073512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-f619203c-9ee0-42ae-bcd6-381e21677569 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:51.074804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 240/485] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.082080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a77821-a4fd-4f3c-9a10-d2ffd6b63e7a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.095519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a77821-a4fd-4f3c-9a10-d2ffd6b63e7a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.103193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56a675-3091-42f1-a0b0-5f9b5d06848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.103867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56a675-3091-42f1-a0b0-5f9b5d06848d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.104147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56a675-3091-42f1-a0b0-5f9b5d06848d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.104419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56a675-3091-42f1-a0b0-5f9b5d06848d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.105176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56a675-3091-42f1-a0b0-5f9b5d06848d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.105484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56a675-3091-42f1-a0b0-5f9b5d06848d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.112381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56a675-3091-42f1-a0b0-5f9b5d06848d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.125732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 246/486] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.134033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619203c-9ee0-42ae-bcd6-381e21677569 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.148319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619203c-9ee0-42ae-bcd6-381e21677569 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.160034 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.160877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.161155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.161424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.175940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.177799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.198175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:51.200661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 241/487] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.202669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d033ac-d91d-452a-89e0-e21b4c097ec3 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.202956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d033ac-d91d-452a-89e0-e21b4c097ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.203228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d033ac-d91d-452a-89e0-e21b4c097ec3 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.205417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 247/488] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:51.206811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.211616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b060f4-3635-41e1-b60d-89f4d682c60b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.211968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b060f4-3635-41e1-b60d-89f4d682c60b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.212248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b060f4-3635-41e1-b60d-89f4d682c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.221579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7a8a7-89f7-4c2c-b8cc-a99b92d79dfd admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.226727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.227383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.227660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.227931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.228659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.228989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.230063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-27b060f4-3635-41e1-b60d-89f4d682c60b None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:51.230710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.231383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-27b060f4-3635-41e1-b60d-89f4d682c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:51.240075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 248/489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:51.241434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181f63b-4ad1-4355-be3f-552047674281 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.241711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181f63b-4ad1-4355-be3f-552047674281 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.241978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181f63b-4ad1-4355-be3f-552047674281 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.246317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 242/490] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.248013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 249/491] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:51 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:51.254103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.260441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4039e-4d82-48f2-bd99-6c8ada07a0c3 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.260720 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4039e-4d82-48f2-bd99-6c8ada07a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.260991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4039e-4d82-48f2-bd99-6c8ada07a0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.271612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b2eb4-3db6-44da-9022-55c208901562 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.276494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.277273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.277546 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.278094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.281874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-31a4039e-4d82-48f2-bd99-6c8ada07a0c3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:51.283087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-31a4039e-4d82-48f2-bd99-6c8ada07a0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:51.285927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.288194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.298654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 250/492] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:51.300180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4039e-4d82-48f2-bd99-6c8ada07a0c3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.302776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 11 16:55:51.304235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 243/493] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.310132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.312836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4039e-4d82-48f2-bd99-6c8ada07a0c3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.321041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b6d4c-4ecd-4e59-9a56-5204c8d7f349 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.324571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a87ee-a6fa-4817-972a-2d2d601cadae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.325372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a87ee-a6fa-4817-972a-2d2d601cadae admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.325648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a87ee-a6fa-4817-972a-2d2d601cadae admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.325916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a87ee-a6fa-4817-972a-2d2d601cadae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.333900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.334574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.334861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.335126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.335958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.336258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.338333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.344820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a87ee-a6fa-4817-972a-2d2d601cadae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:51.352070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-4e4a87ee-a6fa-4817-972a-2d2d601cadae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:51.353707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 251/494] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.358565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a87ee-a6fa-4817-972a-2d2d601cadae admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.361223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 244/495] 10.222.0.16 () {56 vars in 1158 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:51.362567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.373441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a87ee-a6fa-4817-972a-2d2d601cadae admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.374514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266061-28a4-4d6f-b527-16b5fa1c8479 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.379353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a597c-b2a4-406a-88dc-f9c7c25b6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.379756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.380408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.380684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.380956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.381216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a597c-b2a4-406a-88dc-f9c7c25b6a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.381684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a597c-b2a4-406a-88dc-f9c7c25b6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.381798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.382000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.382454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a597c-b2a4-406a-88dc-f9c7c25b6a68 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.383616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.391942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 245/496] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.398568 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.406663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a597c-b2a4-406a-88dc-f9c7c25b6a68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:51.408017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ccbf2-fa6a-4f36-bfcf-8244231edd3f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.412598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.413477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.413875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.414247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.415344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-fa7a597c-b2a4-406a-88dc-f9c7c25b6a68 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:51.416933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 252/497] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.417814 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a597c-b2a4-406a-88dc-f9c7c25b6a68 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.427819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.430795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.431986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a597c-b2a4-406a-88dc-f9c7c25b6a68 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.436546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.437417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.437763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.438101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.449940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.451882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.453163 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:51.455324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 246/498] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.456360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.467977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e142b4-8800-4129-a5cc-59ce8e6ab557 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.470526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:51.477112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 253/499] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.477112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.477304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.477304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.477304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.477304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.477649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.477649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.479894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.489935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 247/500] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.491964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49227629-c796-4853-88cb-a8bbf6eb2a21 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.495589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.497445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.498529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.499052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.499518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.500456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.500976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.503785 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.508958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f0f4-3bb0-4d32-a8cd-993f15d16dd0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.513848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.514987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.514987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.515186 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.515997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.516351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.518106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.522144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 254/501] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.523382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.532392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 248/502] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.537663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.540078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb3666-2521-4401-99a2-7ef5e212c3d0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.545878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.546787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c6b8-9b21-4ada-8439-1f454f343087 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.547331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.547911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.548503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.551891 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.552665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.553126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.553231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.560342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.562297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.562861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.566070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.576786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:51.578103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 249/503] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.579002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.584766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:51.587220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 255/504] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.588158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.595289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95f52-a172-4796-892e-cdfeca6886fe admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.599615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a71bd0-5c99-4740-8c8a-0cfbe6bb2481 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.600889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.601840 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.602217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.602568 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.606053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.606969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.607417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.607850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.608806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.609279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.611159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.611838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.614331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.626413 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 256/505] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.627481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.629060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:55:51.635344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 250/506] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.635344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.644704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8db65-0223-44c0-afd9-a2e7af18eb5b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.646755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb15bf-1863-480e-8644-f4d0c2965c4c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.649395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5c257-0c48-476a-bf60-69b6d14ca02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.650377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c257-0c48-476a-bf60-69b6d14ca02d admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.650691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c257-0c48-476a-bf60-69b6d14ca02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.650958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c257-0c48-476a-bf60-69b6d14ca02d admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/8a061423c1f646b8892d646979f84f20/roles/d9aae4994e18459dae9fd6b22e704d75` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.653092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.654120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.655425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.655848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.656865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.657329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.659589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.666842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5c257-0c48-476a-bf60-69b6d14ca02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=8a061423c1f646b8892d646979f84f20, role_id=d9aae4994e18459dae9fd6b22e704d75)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.669471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5c257-0c48-476a-bf60-69b6d14ca02d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.674470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 257/507] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.676085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.685481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6b26d-bf2a-4e59-9ee9-8af54ad3559a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.689860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d23ca-5489-4cae-9228-8405bfd3e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.690552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d23ca-5489-4cae-9228-8405bfd3e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.690853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d23ca-5489-4cae-9228-8405bfd3e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.691125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d23ca-5489-4cae-9228-8405bfd3e4ad admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.691957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d23ca-5489-4cae-9228-8405bfd3e4ad admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.692260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d23ca-5489-4cae-9228-8405bfd3e4ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.694070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d23ca-5489-4cae-9228-8405bfd3e4ad admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.716133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 258/508] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.716133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dc042-21ef-42d5-a53b-984a7600088c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.716133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dc042-21ef-42d5-a53b-984a7600088c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.716133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dc042-21ef-42d5-a53b-984a7600088c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.716133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 259/509] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:51.716521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dc042-21ef-42d5-a53b-984a7600088c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.729140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dc042-21ef-42d5-a53b-984a7600088c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.733443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.734184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.734461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.734761 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.742930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.744921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.758920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 11 16:55:51.760225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 260/510] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.760879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.770455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf56a-8cf7-4711-ae62-01444e6d36b8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.774866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.775591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.775866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.776132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.784769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 251/511] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:51 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/8a061423c1f646b8892d646979f84f20/roles/d9aae4994e18459dae9fd6b22e704d75 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:51.786024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab425a6-0424-49ef-88a6-1ec793420daa None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.786306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab425a6-0424-49ef-88a6-1ec793420daa None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.786600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab425a6-0424-49ef-88a6-1ec793420daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.787887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.789767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.809885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:51.811344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 261/512] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.812085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.813279 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7ab425a6-0424-49ef-88a6-1ec793420daa None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:51.814519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7ab425a6-0424-49ef-88a6-1ec793420daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:51.822701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b362bf-9ddf-49ef-998a-808d6ac29b9d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.885416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 252/513] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:51.886362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab425a6-0424-49ef-88a6-1ec793420daa None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.895339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.896037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.896316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.896483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab425a6-0424-49ef-88a6-1ec793420daa None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.896634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.897642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.898019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.900367 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.901687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.902633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.903112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.903549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.904552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:51.905049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.906953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.920583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 253/514] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.929933 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.936002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 262/515] 10.222.0.16 () {56 vars in 1158 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:51.937164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.947128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244bbc1-dfb9-4652-ae58-a06a5377a24c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.951556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603e66-0552-46a1-bce9-b6de632be78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.952108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d439e7-dbfe-47b5-93fc-e955c938d4c9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.952615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603e66-0552-46a1-bce9-b6de632be78b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.952615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603e66-0552-46a1-bce9-b6de632be78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.952939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603e66-0552-46a1-bce9-b6de632be78b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.957366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:51.958897 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:51.959383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:51.959884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:51.967036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81603e66-0552-46a1-bce9-b6de632be78b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:51.969669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:51.974377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:51.975176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-81603e66-0552-46a1-bce9-b6de632be78b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:51.976383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 263/516] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.982676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603e66-0552-46a1-bce9-b6de632be78b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:51.992821 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:51.994194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603e66-0552-46a1-bce9-b6de632be78b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:51.994966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 254/517] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:51.996260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.004278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.004937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.005214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.005486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.013529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff6cc-7c64-46eb-9d80-b3d9308b4579 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.018139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.019465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.019772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.020089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.020864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.021170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.021435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.022842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.023683 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.031645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 255/518] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.032300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.042807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:52.044284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 264/519] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:52.045045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.048773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1f9cf-8d99-41aa-861d-96abfd425505 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.054241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.054919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.055192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.055294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9580d-7007-4c7d-8705-3f2b8ba375d9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.055461 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.056249 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.056548 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.058422 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.059757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.060520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.060800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.061072 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.073955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 256/520] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.074355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.075227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.076347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.086747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc250c3-36ae-4521-9da3-2964e2a3ae86 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.094046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.094939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.095519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.096054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.096237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:52.097832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.098104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 265/521] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:52.098485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.098941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.101855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.109307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d336b-445e-40b4-9bf0-a64284b7363f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.114287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd4d2f-7da2-4a53-b429-aeb7204cdc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.115208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4d2f-7da2-4a53-b429-aeb7204cdc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.115533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4d2f-7da2-4a53-b429-aeb7204cdc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.115803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4d2f-7da2-4a53-b429-aeb7204cdc09 admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/0941777cfcbf4532be31ca001ced8aa7/roles/d9aae4994e18459dae9fd6b22e704d75` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.117616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 257/522] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.118683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.129304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdb54c-6788-4e72-9ca4-525fc774ef8f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.133885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.134564 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.134866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.135247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.136086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.136391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.136979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd4d2f-7da2-4a53-b429-aeb7204cdc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=0941777cfcbf4532be31ca001ced8aa7, role_id=d9aae4994e18459dae9fd6b22e704d75)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.137986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.140087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd4d2f-7da2-4a53-b429-aeb7204cdc09 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.150749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 258/523] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.155700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.161938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd431235-abe2-49bf-926f-6a51963eb09e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.166116 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.166919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.167196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.167492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.174323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.176375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.189375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:52.190733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 259/524] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:52.191391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.201896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0f80a-5120-4441-896f-af62136f575c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.206693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f00227-0f68-40fe-94a6-586401373884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.207518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00227-0f68-40fe-94a6-586401373884 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.207696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00227-0f68-40fe-94a6-586401373884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.209778 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00227-0f68-40fe-94a6-586401373884 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.211653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 266/525] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:52 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/0941777cfcbf4532be31ca001ced8aa7/roles/d9aae4994e18459dae9fd6b22e704d75 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:52.216058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f00227-0f68-40fe-94a6-586401373884 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.216619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e318b5-50a0-4bff-8cde-8ab19ac90dab None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.217181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e318b5-50a0-4bff-8cde-8ab19ac90dab None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.217634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e318b5-50a0-4bff-8cde-8ab19ac90dab None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.218591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f00227-0f68-40fe-94a6-586401373884 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.220419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 267/526] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:52 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:52.223050 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e318b5-50a0-4bff-8cde-8ab19ac90dab None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.237251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-a0f00227-0f68-40fe-94a6-586401373884 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 11 16:55:52.239516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 260/527] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:52.241471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88759-a1fb-4731-ab74-a99ceb1bc652 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.241864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88759-a1fb-4731-ab74-a99ceb1bc652 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.242295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88759-a1fb-4731-ab74-a99ceb1bc652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.266132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4dd88759-a1fb-4731-ab74-a99ceb1bc652 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:52.269201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4dd88759-a1fb-4731-ab74-a99ceb1bc652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:52.307816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e318b5-50a0-4bff-8cde-8ab19ac90dab None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.314658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.315611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.316038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.316486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.317444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.317912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.320579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.340343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 268/528] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.341547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.344395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 261/529] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:52.349322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88759-a1fb-4731-ab74-a99ceb1bc652 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.353454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeea4a-6507-4af2-89fe-c44bce174609 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.359194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.360149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.360445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88759-a1fb-4731-ab74-a99ceb1bc652 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.360783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.361202 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.362614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.363191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.365930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.366290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae37b-3195-4975-b8e3-93acf492ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.367377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae37b-3195-4975-b8e3-93acf492ce16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.367751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae37b-3195-4975-b8e3-93acf492ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.368159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae37b-3195-4975-b8e3-93acf492ce16 admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/b88bc12e78894bdbaf79d148c3dd2e2a/roles/d9aae4994e18459dae9fd6b22e704d75` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.387755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ae37b-3195-4975-b8e3-93acf492ce16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=b88bc12e78894bdbaf79d148c3dd2e2a, role_id=d9aae4994e18459dae9fd6b22e704d75)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.390383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 269/530] 10.222.0.16 () {56 vars in 1160 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.391147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ae37b-3195-4975-b8e3-93acf492ce16 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.391690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.403261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd49dfe-1919-454f-8527-683aeebbafb6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.408001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1766bd-dbe6-42e0-b3c4-735e038a256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.409333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1766bd-dbe6-42e0-b3c4-735e038a256e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.409881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1766bd-dbe6-42e0-b3c4-735e038a256e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.410090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1766bd-dbe6-42e0-b3c4-735e038a256e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.425616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1766bd-dbe6-42e0-b3c4-735e038a256e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:52.433064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-ac1766bd-dbe6-42e0-b3c4-735e038a256e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:52.434568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 270/531] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:52.435163 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1766bd-dbe6-42e0-b3c4-735e038a256e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.445284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1766bd-dbe6-42e0-b3c4-735e038a256e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.450037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.450871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.451153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.451425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.463307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.465142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.489976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:52.493500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 271/532] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:52.494417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.506010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce1ee5-2b72-4206-b679-a23fe5b06350 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.516000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 262/533] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:52 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/b88bc12e78894bdbaf79d148c3dd2e2a/roles/d9aae4994e18459dae9fd6b22e704d75 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:52.519383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae37b-3195-4975-b8e3-93acf492ce16 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.522459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.523168 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.523443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.523715 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.524485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.524781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.526382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.537829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 272/534] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.544568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.558256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62ed1c-abf4-4a94-bbdf-5a9427d546d7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.597413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae37b-3195-4975-b8e3-93acf492ce16 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.602926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.604334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.604913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.605372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.606378 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.606978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.609495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.625062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 263/535] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.632424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.645913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3535d-d32a-45c5-9bda-d784968cf3ca admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.658353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.659675 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.660175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.660649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.666686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.670990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.671633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.672107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.683547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.685583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.687486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.689778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.710178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:52.710504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:52.712158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 264/537] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:52.712374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 273/537] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:52.719994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.723512 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.742711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbe62b-cbb5-46c4-8f2b-1d4449b840c9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.745150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3381a76-dd9c-4afe-83f5-f9f87d863c31 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.754932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.755942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.756840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.757697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.758188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.758713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.759222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.760201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.760699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.761707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.762222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.764120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.764679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.768166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.784006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 274/538] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:52.790606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 265/539] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:52.791806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.796312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.806868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef250-ea31-4de7-b372-8e03509ff214 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.807770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0a791-e966-4dd7-8406-541ef6255ef8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.818968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721830a-5e78-4cba-b570-02d0cdbcbff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.819326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.820323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.820639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721830a-5e78-4cba-b570-02d0cdbcbff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.820924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721830a-5e78-4cba-b570-02d0cdbcbff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.821068 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.821196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721830a-5e78-4cba-b570-02d0cdbcbff7 admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/872474833e2f49c9a9ceccef8914e2b8/roles/d9aae4994e18459dae9fd6b22e704d75` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.821597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.831955 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.837595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.850576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:55:52.851500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721830a-5e78-4cba-b570-02d0cdbcbff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=872474833e2f49c9a9ceccef8914e2b8, role_id=d9aae4994e18459dae9fd6b22e704d75)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.852546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 275/540] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:52.854250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721830a-5e78-4cba-b570-02d0cdbcbff7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.860793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.871275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c2059-4fae-4167-982f-ba25dfd28e47 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.876093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.876745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.877026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.877299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.878759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:52.879065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.880898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.899261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 276/541] 10.222.0.16 () {56 vars in 1156 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:52.905271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.914748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0420b2-e588-4f17-b609-097be9f8e523 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.919217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ca32f-278c-46eb-8f65-3cc00e0c97e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.919849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca32f-278c-46eb-8f65-3cc00e0c97e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.920152 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca32f-278c-46eb-8f65-3cc00e0c97e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.920399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca32f-278c-46eb-8f65-3cc00e0c97e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.929165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ca32f-278c-46eb-8f65-3cc00e0c97e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.930955 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ca32f-278c-46eb-8f65-3cc00e0c97e2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:52.945660 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 277/542] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:55:52.946906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ca32f-278c-46eb-8f65-3cc00e0c97e2 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:52.955764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ca32f-278c-46eb-8f65-3cc00e0c97e2 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:52.960436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:52.961263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:52.961540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:52.961811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:52.972950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:52.974835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:53.001301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:53.001301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 278/543] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:53.001301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:53.003156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 266/544] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:52 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/872474833e2f49c9a9ceccef8914e2b8/roles/d9aae4994e18459dae9fd6b22e704d75 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:55:53.012737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e1489-c7ab-4470-8ef8-40fb6392f953 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:53.099610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:53.100397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:53.100748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:53.101090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:53.101907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:53.102281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:53.104153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:53.128605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 279/545] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:53.135100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721830a-5e78-4cba-b570-02d0cdbcbff7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:53.152046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721830a-5e78-4cba-b570-02d0cdbcbff7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:53.168344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:53.169390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:53.169808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:53.170240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:53.178456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:53.180575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:53.202443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:53.204219 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 267/546] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:53.210947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:53.228204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737df3f0-fef9-44c8-a531-b377bfa478c3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:53.236047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce06f-7280-4961-9b10-6399a6a555a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:53.236883 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce06f-7280-4961-9b10-6399a6a555a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:53.237819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce06f-7280-4961-9b10-6399a6a555a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:53.238195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce06f-7280-4961-9b10-6399a6a555a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:53.239533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce06f-7280-4961-9b10-6399a6a555a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:53.239916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce06f-7280-4961-9b10-6399a6a555a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:53.242117 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce06f-7280-4961-9b10-6399a6a555a9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:53.269545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 280/547] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:53.270871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:53.281723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2663d6d-57aa-42c9-b57a-0f77490a54c7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:53.287037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41acf84-7a7b-4ca3-abdb-745a13defa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:53.287814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41acf84-7a7b-4ca3-abdb-745a13defa32 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:53.288165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41acf84-7a7b-4ca3-abdb-745a13defa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:53.288554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41acf84-7a7b-4ca3-abdb-745a13defa32 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:53.289450 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41acf84-7a7b-4ca3-abdb-745a13defa32 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=cc5d09e583e942e998f2c9808f1dc5b6) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:53.289869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41acf84-7a7b-4ca3-abdb-745a13defa32 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:53.291851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41acf84-7a7b-4ca3-abdb-745a13defa32 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:53.300976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 268/548] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:53 2021] GET /identity/v3/role_assignments?user.id=cc5d09e583e942e998f2c9808f1dc5b6&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:54.532398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706ed8-79d5-413a-b17f-cf1438215390 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.533285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706ed8-79d5-413a-b17f-cf1438215390 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.533760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706ed8-79d5-413a-b17f-cf1438215390 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.536710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 281/549] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:54.548185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4046-2d19-4243-92dd-77add354415a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.548686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4046-2d19-4243-92dd-77add354415a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.548759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4046-2d19-4243-92dd-77add354415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.571543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6f9d4046-2d19-4243-92dd-77add354415a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:54.572750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6f9d4046-2d19-4243-92dd-77add354415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:54.583988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 269/550] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:54.610261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb706ed8-79d5-413a-b17f-cf1438215390 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:54.627275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb706ed8-79d5-413a-b17f-cf1438215390 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:54.632242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f48f1-cec3-408b-a7a0-95ff56072bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:54.633055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f48f1-cec3-408b-a7a0-95ff56072bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.633474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f48f1-cec3-408b-a7a0-95ff56072bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.633754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f48f1-cec3-408b-a7a0-95ff56072bb6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.650184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f48f1-cec3-408b-a7a0-95ff56072bb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:54.657655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-2f1f48f1-cec3-408b-a7a0-95ff56072bb6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:54.659131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 282/551] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:54.665752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4046-2d19-4243-92dd-77add354415a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:54.675037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4046-2d19-4243-92dd-77add354415a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:54.682215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:54.682920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.683200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.683476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.684247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:54.684554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:54.686152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:54.698206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 270/552] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:54.704278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f48f1-cec3-408b-a7a0-95ff56072bb6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:54.714766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f48f1-cec3-408b-a7a0-95ff56072bb6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:54.722731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:54.723527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.723807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.724077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.735749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:54.737646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:54.757041 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:54.758664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 283/553] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:54.764805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:54.780001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6f955-c133-42eb-a366-a35c871e006c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:54.787223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:54.787836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.788119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.788396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.789133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:54.789449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:54.791070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:54.808830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 271/554] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:54.815888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:54.825936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece38bb7-f0bb-4436-8717-3716827eb314 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:54.835541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:54.836348 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.836625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.838650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.845668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:54.847887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:54.862292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 11 16:55:54.864851 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 284/555] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:54.870962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:54.883604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6539e-235b-48c8-a6e2-a97a6b170420 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:54.891155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:54.891855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.892139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.892419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.893795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:54.894114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:54.896000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:54.918006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 272/556] 10.222.0.16 () {56 vars in 1158 bytes} [Thu Nov 11 16:55:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:54.924575 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:54.934501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06972-4e70-45f5-93f0-7c9647da0392 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:54.943173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe033a4-eab4-4233-9082-079a6e33806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:54.943813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe033a4-eab4-4233-9082-079a6e33806f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:54.944094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe033a4-eab4-4233-9082-079a6e33806f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:54.944370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe033a4-eab4-4233-9082-079a6e33806f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:54.958845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe033a4-eab4-4233-9082-079a6e33806f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:54.960608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe033a4-eab4-4233-9082-079a6e33806f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:54.969868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 285/557] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:54.976338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:54.992405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8695d6-c7d5-4b0e-836e-a3d7984b4575 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:54.999309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.000112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.000396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.000664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.011706 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.013538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.036969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:55.038395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 273/558] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:55.044676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe033a4-eab4-4233-9082-079a6e33806f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.054342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe033a4-eab4-4233-9082-079a6e33806f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.062579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.063235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.063516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.063797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.064521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.064823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.066994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.087713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 286/559] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:55.094192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.107991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9062fe3-3031-49c7-a7c8-2fcef75aa269 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.113822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.114904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.115184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.115454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.127424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.130095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.152473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:55.153909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 274/560] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:55.163620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.173843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21049319-38f6-484e-8e60-f50548ffc3dc admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.186695 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f356a-3e42-4113-98cd-10717b6970c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.187646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f356a-3e42-4113-98cd-10717b6970c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.188177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f356a-3e42-4113-98cd-10717b6970c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.188650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f356a-3e42-4113-98cd-10717b6970c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.189652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f356a-3e42-4113-98cd-10717b6970c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.190717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f356a-3e42-4113-98cd-10717b6970c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.192790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f356a-3e42-4113-98cd-10717b6970c4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.214603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 287/561] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:55.221103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.235594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13055235-89cc-43a9-a7e8-9b5ee2c0258e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.247699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619296ab-36d5-4896-b802-681a76fbc9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.248353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619296ab-36d5-4896-b802-681a76fbc9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.248631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619296ab-36d5-4896-b802-681a76fbc9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.248902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619296ab-36d5-4896-b802-681a76fbc9d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.249742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619296ab-36d5-4896-b802-681a76fbc9d2 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=8a061423c1f646b8892d646979f84f20) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.250050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619296ab-36d5-4896-b802-681a76fbc9d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.251902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619296ab-36d5-4896-b802-681a76fbc9d2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.259100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 275/562] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/role_assignments?user.id=8a061423c1f646b8892d646979f84f20&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:55.377862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6f96-d731-407a-83ff-718bec36c8f0 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.378522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6f96-d731-407a-83ff-718bec36c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.379067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6f96-d731-407a-83ff-718bec36c8f0 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.381420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 288/563] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:55.387841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2940-16e7-4a35-bbc6-f66e611c7bff None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.388142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2940-16e7-4a35-bbc6-f66e611c7bff None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.388398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2940-16e7-4a35-bbc6-f66e611c7bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.413318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-39ee2940-16e7-4a35-bbc6-f66e611c7bff None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:55.414508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-39ee2940-16e7-4a35-bbc6-f66e611c7bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:55.425489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 276/564] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:55.463548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f6f96-d731-407a-83ff-718bec36c8f0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.480255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f6f96-d731-407a-83ff-718bec36c8f0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.491662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7745-768e-4525-90cf-777884779f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.492827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7745-768e-4525-90cf-777884779f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.493333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7745-768e-4525-90cf-777884779f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.493806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7745-768e-4525-90cf-777884779f25 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.506752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7745-768e-4525-90cf-777884779f25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:55.514207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-25ab7745-768e-4525-90cf-777884779f25 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:55.515781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 289/565] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:55.521859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2940-16e7-4a35-bbc6-f66e611c7bff None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.532292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2940-16e7-4a35-bbc6-f66e611c7bff None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.541473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbf1f8-8d07-40e4-a8f7-ba21ab03a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.542222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbf1f8-8d07-40e4-a8f7-ba21ab03a981 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.542506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbf1f8-8d07-40e4-a8f7-ba21ab03a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.542802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbf1f8-8d07-40e4-a8f7-ba21ab03a981 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.543726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbf1f8-8d07-40e4-a8f7-ba21ab03a981 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.544037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbf1f8-8d07-40e4-a8f7-ba21ab03a981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.545645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbf1f8-8d07-40e4-a8f7-ba21ab03a981 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.554336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41376ef-e2ed-421e-83d9-d3e4e39499e4 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.554884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41376ef-e2ed-421e-83d9-d3e4e39499e4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.554884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41376ef-e2ed-421e-83d9-d3e4e39499e4 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.556156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 277/566] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:55.556865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 290/567] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:55.562805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e694710-7ce6-4126-b44a-114219674f83 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.563096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e694710-7ce6-4126-b44a-114219674f83 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.563220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41376ef-e2ed-421e-83d9-d3e4e39499e4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.563374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e694710-7ce6-4126-b44a-114219674f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.579055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41376ef-e2ed-421e-83d9-d3e4e39499e4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.584143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4e694710-7ce6-4126-b44a-114219674f83 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:55.585103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.585328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4e694710-7ce6-4126-b44a-114219674f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:55.585932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.586354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.586779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.594006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 278/568] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:55.602767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.604727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.621805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e694710-7ce6-4126-b44a-114219674f83 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.629603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:55.631373 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 291/569] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:55.634688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e694710-7ce6-4126-b44a-114219674f83 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.637579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.637972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e450508-27ee-4da6-8103-e422eda675c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.639075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e450508-27ee-4da6-8103-e422eda675c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.639565 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e450508-27ee-4da6-8103-e422eda675c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.640113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e450508-27ee-4da6-8103-e422eda675c1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.649064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a74cc-52e1-4d80-b5cc-8c40aa48ce55 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.653998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e450508-27ee-4da6-8103-e422eda675c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:55.654508 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.655251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.655635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.656007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.656800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.657164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.658932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.664207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-7e450508-27ee-4da6-8103-e422eda675c1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:55.666565 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 279/570] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:55.673569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e450508-27ee-4da6-8103-e422eda675c1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.677932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 292/571] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:55.682149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.688635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e450508-27ee-4da6-8103-e422eda675c1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.693079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ab42-3f15-4ee0-86cd-34003d90d570 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.700205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.701151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.701979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.702261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.702533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.703994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.704269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.704538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.705314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.705621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.707862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.716746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.719437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.719579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 280/572] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:55.726902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.738082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:55:55.738327 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455160c-0130-4020-8f1b-67f7446ed455 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.740442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 293/573] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:55.744217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.745200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.745580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.746172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.747225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.759439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.760930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e60475-673f-4b4a-8f1f-7285ed2b6591 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.761567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.766396 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.767402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.767820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.768348 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.769372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.769816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.772921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.782186 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:55.783750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 281/574] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:55.790971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.799069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 294/575] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:55.805023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc686-d7d6-4681-b0fe-9be8418d6ae7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.806108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.810682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.811720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.812150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.812521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.813989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.814403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.816976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.817798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78faffab-ef69-4533-ba84-49fe82623ec1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.827002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1483-c719-40cc-8f1d-5eeda459be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.827955 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1483-c719-40cc-8f1d-5eeda459be83 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.828410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1483-c719-40cc-8f1d-5eeda459be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.828784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1483-c719-40cc-8f1d-5eeda459be83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.830728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 282/576] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:55.838904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b1483-c719-40cc-8f1d-5eeda459be83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.840009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.842335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b1483-c719-40cc-8f1d-5eeda459be83 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.851713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1db76-bd2c-41aa-b2fe-08f844b20757 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.857372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4d1c-3b44-4402-affe-dc9c1e5a0c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.865122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4d1c-3b44-4402-affe-dc9c1e5a0c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.865235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 295/577] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:55.865318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4d1c-3b44-4402-affe-dc9c1e5a0c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.865318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4d1c-3b44-4402-affe-dc9c1e5a0c3c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.867180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1483-c719-40cc-8f1d-5eeda459be83 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.875149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd4d1c-3b44-4402-affe-dc9c1e5a0c3c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.877240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd4d1c-3b44-4402-affe-dc9c1e5a0c3c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.877571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1483-c719-40cc-8f1d-5eeda459be83 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.890594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ed657-fc72-42a9-b1a8-651829a34622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.891568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ed657-fc72-42a9-b1a8-651829a34622 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.891947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ed657-fc72-42a9-b1a8-651829a34622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.892276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ed657-fc72-42a9-b1a8-651829a34622 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.897880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-13fd4d1c-3b44-4402-affe-dc9c1e5a0c3c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 11 16:55:55.900117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 283/578] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/users/cinder => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:55.901631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7bcff-07a1-4570-b909-6768623fc97a None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.913316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7bcff-07a1-4570-b909-6768623fc97a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.913316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7bcff-07a1-4570-b909-6768623fc97a None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.913508 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ed657-fc72-42a9-b1a8-651829a34622 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.913582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 284/579] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:55.913582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7bcff-07a1-4570-b909-6768623fc97a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.913731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ed657-fc72-42a9-b1a8-651829a34622 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.925991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7bcff-07a1-4570-b909-6768623fc97a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.931092 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.931581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-923ed657-fc72-42a9-b1a8-651829a34622 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:55.932101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.932515 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.932878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.933806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 296/580] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:55.934061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.934462 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.935703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca98f29-b89e-46cc-875d-c3f005196ca0 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.936233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca98f29-b89e-46cc-875d-c3f005196ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.936636 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca98f29-b89e-46cc-875d-c3f005196ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.941642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.962100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 285/581] 10.222.0.16 () {56 vars in 1158 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:55.962674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9ca98f29-b89e-46cc-875d-c3f005196ca0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:55.962913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.964471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9ca98f29-b89e-46cc-875d-c3f005196ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:55.973196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5cde3-76c3-4ad7-9cd1-15a6436aeb4d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:55.974228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 297/582] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:55.975267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca98f29-b89e-46cc-875d-c3f005196ca0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:55.988082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:55.989442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:55.989945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:55.990584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:55.992541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:55.993677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:55.996885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:55.997337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca98f29-b89e-46cc-875d-c3f005196ca0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.005585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278423-52be-444d-aabe-88ba3443bb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.006244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278423-52be-444d-aabe-88ba3443bb65 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.006522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278423-52be-444d-aabe-88ba3443bb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.006813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278423-52be-444d-aabe-88ba3443bb65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.013637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 286/583] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.018573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.018712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278423-52be-444d-aabe-88ba3443bb65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.018712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278423-52be-444d-aabe-88ba3443bb65 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.029501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 298/584] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:56.030423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278423-52be-444d-aabe-88ba3443bb65 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.032027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67410b08-d488-46b5-80bb-eda84169e6f1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.039885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64291d1-109b-4096-9aed-c01506e83811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.041032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278423-52be-444d-aabe-88ba3443bb65 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.041276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64291d1-109b-4096-9aed-c01506e83811 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.041770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64291d1-109b-4096-9aed-c01506e83811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.042285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64291d1-109b-4096-9aed-c01506e83811 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.045995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a88aa9-53a8-4c08-afe5-ea3ada45a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.046925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a88aa9-53a8-4c08-afe5-ea3ada45a7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.047202 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a88aa9-53a8-4c08-afe5-ea3ada45a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.047474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a88aa9-53a8-4c08-afe5-ea3ada45a7e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.055392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64291d1-109b-4096-9aed-c01506e83811 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:56.056310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a88aa9-53a8-4c08-afe5-ea3ada45a7e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.058282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a88aa9-53a8-4c08-afe5-ea3ada45a7e8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.063367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-b64291d1-109b-4096-9aed-c01506e83811 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:56.064862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 287/585] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.066406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64291d1-109b-4096-9aed-c01506e83811 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.073858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-00a88aa9-53a8-4c08-afe5-ea3ada45a7e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:56.075219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 299/586] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.076286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56965486-229c-4762-b1bb-3b81999805f0 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.076571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56965486-229c-4762-b1bb-3b81999805f0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.076845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56965486-229c-4762-b1bb-3b81999805f0 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.078649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 300/587] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:56.083429 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56965486-229c-4762-b1bb-3b81999805f0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.086040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64291d1-109b-4096-9aed-c01506e83811 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.090417 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503dac2-386b-42d2-ba39-6fa5447b51a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.091230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503dac2-386b-42d2-ba39-6fa5447b51a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.091495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503dac2-386b-42d2-ba39-6fa5447b51a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.091761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503dac2-386b-42d2-ba39-6fa5447b51a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.097192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56965486-229c-4762-b1bb-3b81999805f0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.102289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503dac2-386b-42d2-ba39-6fa5447b51a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.102501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.103164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.103444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.103712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.104214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503dac2-386b-42d2-ba39-6fa5447b51a8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.104468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.104743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.106462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.120525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 301/588] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.121688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.121795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-e503dac2-386b-42d2-ba39-6fa5447b51a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:56.122899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 288/589] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.124061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d3d7-aa52-4ad9-8494-c8e263b075ff None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.124343 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d3d7-aa52-4ad9-8494-c8e263b075ff None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.124612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d3d7-aa52-4ad9-8494-c8e263b075ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.135489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5238d-a548-455a-b08c-1ab114d2d829 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.139846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.140489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.140819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.141031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.141817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.142150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.143148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-62e8d3d7-aa52-4ad9-8494-c8e263b075ff None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:56.143976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.144369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-62e8d3d7-aa52-4ad9-8494-c8e263b075ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:56.152266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 289/590] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:56.152829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d3d7-aa52-4ad9-8494-c8e263b075ff None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.162768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d3d7-aa52-4ad9-8494-c8e263b075ff None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.167361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.167998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.168304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.168547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.169264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.169562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.171179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.173432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 302/591] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.175207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.186796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c8d46-5c51-4cd2-a531-ea5b356e7c9f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.188403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 290/592] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.189250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.192137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.193145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.193884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.194290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.198198 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e52bbe-012e-4c5c-b046-a7fd5b953e68 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.202588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74c7b-0ace-4ff5-9e0c-2b94f8f648a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.203356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74c7b-0ace-4ff5-9e0c-2b94f8f648a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.203630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74c7b-0ace-4ff5-9e0c-2b94f8f648a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.203899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74c7b-0ace-4ff5-9e0c-2b94f8f648a0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.208596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.211185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.214329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff74c7b-0ace-4ff5-9e0c-2b94f8f648a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:56.221277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-cff74c7b-0ace-4ff5-9e0c-2b94f8f648a0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:55:56.223006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 291/593] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.223737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74c7b-0ace-4ff5-9e0c-2b94f8f648a0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.229773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:56.236325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 303/594] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.236325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.240115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74c7b-0ace-4ff5-9e0c-2b94f8f648a0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.244475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.245096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.245373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.245637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.246470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=0941777cfcbf4532be31ca001ced8aa7) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.246841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.247011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6555-5ba3-4a93-93d5-8bc8a891b9f0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.248629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.251459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.252204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.252491 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.252787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.262614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 292/595] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/role_assignments?user.id=0941777cfcbf4532be31ca001ced8aa7&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.262614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.265037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9b59-8518-4672-a5d4-4b236b3f8b25 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.268458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.269696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.270366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.270679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.270795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.270967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.271715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.272016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.273887 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.282860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 293/596] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.283595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.296563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:56.298257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 304/597] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.299106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.304852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906af442-1784-4f6c-890b-f31785e9ae56 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.310256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.311023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.311251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.311571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.312323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.312626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.314226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.315537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bc16-56d1-4a1e-b8cd-e02bf8f3aa08 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.321030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.322142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.322644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.323053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.332822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 294/598] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.332822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.339877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f823ae7-4163-404b-871c-6faceebba34b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.341300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.343463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.344630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.345309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.345592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.345869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.347240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.347553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.349431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.366024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:56.367600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 305/600] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.368671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.369425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 295/600] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.370409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.381084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ee8e-3c21-4051-b4c9-234031733a5b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.385383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694e13f-92dc-4447-8f5b-1d5b3832c519 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.385683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.386347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.386672 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.386957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.387914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=b88bc12e78894bdbaf79d148c3dd2e2a) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.388241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.390429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.392189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.393896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.394380 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.394867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.397950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 296/601] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/role_assignments?user.id=b88bc12e78894bdbaf79d148c3dd2e2a&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.404435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.406095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.407409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.419985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc95552-6c75-46d7-b6a6-85507633ec86 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.425546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 11 16:55:56.430852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 306/602] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.434969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.439402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.440604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.440894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.441169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.441926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.442233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.443904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.448767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f4ab1-7dd6-496e-a7a7-d43febfec418 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.454926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.456597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.457840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.458423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.459589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.460180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.462393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.478466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 297/603] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.480543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.506355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 307/604] 10.222.0.16 () {56 vars in 1160 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.507969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b3400-1fc0-4d5d-8eac-763d2fd8eee7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.508398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.514464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.515556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.515642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.515886 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.524269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e687a5f-638e-41b1-9f77-7598d5297793 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.530224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.531795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7dea-debb-47ce-95bb-69fb12a66ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.532585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.532894 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7dea-debb-47ce-95bb-69fb12a66ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.533523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7dea-debb-47ce-95bb-69fb12a66ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.534125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7dea-debb-47ce-95bb-69fb12a66ff9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.547189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf7dea-debb-47ce-95bb-69fb12a66ff9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.549244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf7dea-debb-47ce-95bb-69fb12a66ff9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.552504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:55:56.558583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 298/605] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/users/swift => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:56.561299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.562602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 308/606] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 16:55:56.570948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7dea-debb-47ce-95bb-69fb12a66ff9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.580545 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f213c54-c4be-4e51-9911-f050a59e118c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.583940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf7dea-debb-47ce-95bb-69fb12a66ff9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.587087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.588234 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.588686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.588945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.589402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.589502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.589776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.590049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.591275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.591814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.594667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.603324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.605253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.625337 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 299/607] 10.222.0.16 () {56 vars in 1156 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:56.627073 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.627301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:56.629381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 309/608] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:56.635861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.639709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07931181-e205-47bd-8f4b-76f215fa58aa admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.645706 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.646779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.647106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f712f-d0bb-4476-bf8d-b54d948dc6a4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.647356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.647785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.652898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.653726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.654187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.654568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.655402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.655861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.657685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.661056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.663529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.673038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 310/609] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:56.679498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.685108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:56.690791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 300/610] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.691020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2d4e9-fdcf-4d03-8802-10a7711a0c4a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.693782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.701457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.702259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.702610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.702959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.705192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86da127-ff4f-4962-8c81-4471e98f0a1a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.712271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.712704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.713600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.714052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.714248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.714725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.715674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.716231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.717842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.728505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:56.729578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 301/611] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:56.729914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 311/612] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:55:56.735419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.737690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.747149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24f7f9-f21a-4287-be20-cde2d833bff4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.747991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f130-6ced-4227-a772-155980a4c1e1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.751668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.752444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.752571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.753264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.753518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.753615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.753885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.754157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.755968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.755968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.757356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.762562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.764596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.772287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 312/613] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.778604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:56.779032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.779769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 302/614] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:56.786976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.796671 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5490c1e-701d-4498-8de7-53ec4624f445 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.797044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ef88-4aa5-436b-befb-b0c37f2d48df admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.803551 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031fe90-8048-4101-b4a5-a99921919b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.803818 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.804212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031fe90-8048-4101-b4a5-a99921919b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.804408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.804580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031fe90-8048-4101-b4a5-a99921919b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.804726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.804873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031fe90-8048-4101-b4a5-a99921919b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.805043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.805605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031fe90-8048-4101-b4a5-a99921919b72 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.805804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=872474833e2f49c9a9ceccef8914e2b8) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:56.805949 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031fe90-8048-4101-b4a5-a99921919b72 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.806125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.807743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031fe90-8048-4101-b4a5-a99921919b72 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.807935 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.816303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 313/615] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/role_assignments?user.id=872474833e2f49c9a9ceccef8914e2b8&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:56.825360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 303/616] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:55:56.832150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:56.845647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532eb4e-f0bb-4a78-8d58-17a8a28d2416 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:56.860739 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb270945-63cf-4a31-8c1d-04e2eb45b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:56.862670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb270945-63cf-4a31-8c1d-04e2eb45b75a admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:56.863176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb270945-63cf-4a31-8c1d-04e2eb45b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:56.863648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb270945-63cf-4a31-8c1d-04e2eb45b75a admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/cc5d09e583e942e998f2c9808f1dc5b6/roles/d9aae4994e18459dae9fd6b22e704d75` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:56.881772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb270945-63cf-4a31-8c1d-04e2eb45b75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=cc5d09e583e942e998f2c9808f1dc5b6, role_id=d9aae4994e18459dae9fd6b22e704d75)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:56.885077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb270945-63cf-4a31-8c1d-04e2eb45b75a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:56.992583 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 314/617] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:55:56 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/cc5d09e583e942e998f2c9808f1dc5b6/roles/d9aae4994e18459dae9fd6b22e704d75 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:55:58.161635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22fcae-8b43-428c-a478-868b30bd6c0e None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:58.162468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22fcae-8b43-428c-a478-868b30bd6c0e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:58.162984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22fcae-8b43-428c-a478-868b30bd6c0e None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:58.165230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 304/618] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:58.171048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fee715-73e9-4101-ae66-2f00ae29f887 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:58.171464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fee715-73e9-4101-ae66-2f00ae29f887 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:58.171645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fee715-73e9-4101-ae66-2f00ae29f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:58.189493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-60fee715-73e9-4101-ae66-2f00ae29f887 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:58.190728 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-60fee715-73e9-4101-ae66-2f00ae29f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:58.268994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 315/619] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:58.306807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22fcae-8b43-428c-a478-868b30bd6c0e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:58.328263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22fcae-8b43-428c-a478-868b30bd6c0e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:58.337777 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:58.338893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:58.339368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:58.339831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:58.357860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:58.360025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:58.380541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:58.382285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 305/620] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:58.388543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fee715-73e9-4101-ae66-2f00ae29f887 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:58.402600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fee715-73e9-4101-ae66-2f00ae29f887 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:58.407059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a250c-7ad7-4337-a87a-332eff9b9ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:58.407716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a250c-7ad7-4337-a87a-332eff9b9ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:58.407997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a250c-7ad7-4337-a87a-332eff9b9ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:58.408270 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a250c-7ad7-4337-a87a-332eff9b9ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:58.409085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a250c-7ad7-4337-a87a-332eff9b9ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:58.409337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a250c-7ad7-4337-a87a-332eff9b9ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:58.411020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a250c-7ad7-4337-a87a-332eff9b9ddf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:58.434525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 316/621] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:58.435859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:58.455459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751c9d-0388-4022-9dd0-66da34cb94ff admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:58.464550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629366a-288e-4d0f-a253-25099d6852a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:58.465574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629366a-288e-4d0f-a253-25099d6852a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:58.466241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629366a-288e-4d0f-a253-25099d6852a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:58.466734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629366a-288e-4d0f-a253-25099d6852a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:58.467642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629366a-288e-4d0f-a253-25099d6852a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:58.469783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629366a-288e-4d0f-a253-25099d6852a6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:58.568751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 306/622] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:55:58 2021] POST /identity/v3/users => generated 254 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:55:59.061752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc6783-095b-4ac6-9327-794f88dc09bc None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.062139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc6783-095b-4ac6-9327-794f88dc09bc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.062349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc6783-095b-4ac6-9327-794f88dc09bc None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.064391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 317/623] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:59.071038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6427f40-3291-4866-b876-ed1575716720 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.071377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6427f40-3291-4866-b876-ed1575716720 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.071660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6427f40-3291-4866-b876-ed1575716720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.091074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e6427f40-3291-4866-b876-ed1575716720 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:59.092287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e6427f40-3291-4866-b876-ed1575716720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:59.102098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 307/624] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:55:59.126579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc6783-095b-4ac6-9327-794f88dc09bc None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.140514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc6783-095b-4ac6-9327-794f88dc09bc None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.145148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.146182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.146637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.147056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.147875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.149486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:59.149486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:59.149486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:59.150708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.168172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 11 16:55:59.169836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 318/625] 10.222.0.16 () {56 vars in 1150 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:59.178623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6427f40-3291-4866-b876-ed1575716720 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.188217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6427f40-3291-4866-b876-ed1575716720 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.192920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f1cf3-997a-43c5-87e6-9b8bf5a78bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.193743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1cf3-997a-43c5-87e6-9b8bf5a78bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.194172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1cf3-997a-43c5-87e6-9b8bf5a78bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.194633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f1cf3-997a-43c5-87e6-9b8bf5a78bc3 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.195490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f1cf3-997a-43c5-87e6-9b8bf5a78bc3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:59.195938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f1cf3-997a-43c5-87e6-9b8bf5a78bc3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.197105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-571f1cf3-997a-43c5-87e6-9b8bf5a78bc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:59.197105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:55:59.197105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:55:59.198266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f1cf3-997a-43c5-87e6-9b8bf5a78bc3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.205059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 308/626] 10.222.0.16 () {56 vars in 1145 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:59.211582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.224548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a438e-51b1-4cf6-8575-9b1452f14c10 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.229222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5be650-df89-407f-b05f-af95721af85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.230070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be650-df89-407f-b05f-af95721af85a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.230499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be650-df89-407f-b05f-af95721af85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.230936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5be650-df89-407f-b05f-af95721af85a admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.231847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5be650-df89-407f-b05f-af95721af85a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:59.232298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5be650-df89-407f-b05f-af95721af85a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.233457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-7f5be650-df89-407f-b05f-af95721af85a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:55:59.233457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:55:59.233457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:55:59.234647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5be650-df89-407f-b05f-af95721af85a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.242663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 319/627] 10.222.0.16 () {56 vars in 1145 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:59.266743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf14e-bfe2-42ef-bb4f-b0e5ee12ff7f None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.267288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf14e-bfe2-42ef-bb4f-b0e5ee12ff7f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.267753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf14e-bfe2-42ef-bb4f-b0e5ee12ff7f None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.270132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 309/628] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:55:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:55:59.276237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd429-fe07-45ba-afd6-70d150c5781a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.276528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd429-fe07-45ba-afd6-70d150c5781a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.276802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd429-fe07-45ba-afd6-70d150c5781a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.301408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dd9bd429-fe07-45ba-afd6-70d150c5781a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:55:59.303020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dd9bd429-fe07-45ba-afd6-70d150c5781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:55:59.312534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 320/629] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:55:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:55:59.338280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cf14e-bfe2-42ef-bb4f-b0e5ee12ff7f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.352834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cf14e-bfe2-42ef-bb4f-b0e5ee12ff7f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.357711 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0806e-d67a-41c0-b579-3d834dc88ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.358878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0806e-d67a-41c0-b579-3d834dc88ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.359337 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0806e-d67a-41c0-b579-3d834dc88ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.359779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0806e-d67a-41c0-b579-3d834dc88ad7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.379039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0806e-d67a-41c0-b579-3d834dc88ad7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:55:59.386529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-16c0806e-d67a-41c0-b579-3d834dc88ad7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:55:59.388134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 310/630] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:59.394692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bd429-fe07-45ba-afd6-70d150c5781a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.404848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bd429-fe07-45ba-afd6-70d150c5781a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.410709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.411709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.412160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.412597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.413534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:59.414063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.415931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.431937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 321/631] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:59.438182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0806e-d67a-41c0-b579-3d834dc88ad7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.450873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0806e-d67a-41c0-b579-3d834dc88ad7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.455926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.457103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.457616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.458062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.477635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.479863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.508216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:59.509762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 311/632] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:59.515963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.530628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b353955-1ac7-4324-a5a1-8fda16e1d689 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.536097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.537142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.537629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.538089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.539131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:59.539768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.541613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.557630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 322/633] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:59.563513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.573754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062ec2b-6c15-4de8-81d8-35ec38156264 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.578660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.579720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.580245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.581265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.590093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.592533 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.608559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:55:59.610158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 312/634] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:59.620099 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.635445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1df6-8848-4562-a150-e20d51e0923c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.640470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.641383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.641873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.642336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.650569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:59.651114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.653094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.688992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 323/635] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:59.695142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.711371 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d591f-c153-45af-8cd7-f5aec496ac2c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.716099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11f888-62d3-4b88-a16f-33ca0f82b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.716971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11f888-62d3-4b88-a16f-33ca0f82b333 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.717450 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11f888-62d3-4b88-a16f-33ca0f82b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.717915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11f888-62d3-4b88-a16f-33ca0f82b333 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.735375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11f888-62d3-4b88-a16f-33ca0f82b333 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.737517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11f888-62d3-4b88-a16f-33ca0f82b333 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.752066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 313/636] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:55:59.758350 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.772539 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa533ea-b7d8-480f-8215-7abe2d6b7acb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.780454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.781349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.781631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.781901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.798968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.801030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.828076 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:55:59.829336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 324/637] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:59.836309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11f888-62d3-4b88-a16f-33ca0f82b333 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.853155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11f888-62d3-4b88-a16f-33ca0f82b333 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.857881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.858795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.859282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.859765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.860683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:59.861187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.871091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.887529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 314/638] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:55:59.894279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.908613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654948-2980-4d72-ad79-664b060ef954 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.915531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac0c57-ee2b-444c-94d5-0f764e26bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.916374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac0c57-ee2b-444c-94d5-0f764e26bda4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.916656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac0c57-ee2b-444c-94d5-0f764e26bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.917026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac0c57-ee2b-444c-94d5-0f764e26bda4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.926944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac0c57-ee2b-444c-94d5-0f764e26bda4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.928892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac0c57-ee2b-444c-94d5-0f764e26bda4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:55:59.950027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-c1ac0c57-ee2b-444c-94d5-0f764e26bda4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:55:59.951242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 325/639] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:55:59.958112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:55:59.971496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb43d0-2ccd-47fb-9337-0d96514f5f08 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:55:59.977752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:55:59.978732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:55:59.979218 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:55:59.979687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:55:59.980677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:55:59.986570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:55:59.988957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.008050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 315/640] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:55:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:00.014279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d4337-447b-463e-b3d8-5625e3318669 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.014844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d4337-447b-463e-b3d8-5625e3318669 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.015364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d4337-447b-463e-b3d8-5625e3318669 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.015868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.017517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 326/641] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:00.024473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80379af-7dac-44c6-98ff-a2ed9c47f1e9 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.024747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80379af-7dac-44c6-98ff-a2ed9c47f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.025028 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80379af-7dac-44c6-98ff-a2ed9c47f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.040562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4901-5418-41fb-8b97-669be02d3a6c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.046263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.047312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.047811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.048296 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.049366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=0941777cfcbf4532be31ca001ced8aa7) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.049923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.052256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.063977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 316/642] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/role_assignments?user.id=0941777cfcbf4532be31ca001ced8aa7&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:00.066989 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-f80379af-7dac-44c6-98ff-a2ed9c47f1e9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:00.069593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f80379af-7dac-44c6-98ff-a2ed9c47f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:00.080353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 327/643] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:56:00.141392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.155343 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0bad7-9a74-4e88-8433-cd54c473c307 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.161047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78ccd-c636-43e0-9c38-bc4dc85bdb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.162223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78ccd-c636-43e0-9c38-bc4dc85bdb09 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.162822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78ccd-c636-43e0-9c38-bc4dc85bdb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.163327 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e78ccd-c636-43e0-9c38-bc4dc85bdb09 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.182101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e78ccd-c636-43e0-9c38-bc4dc85bdb09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:00.190896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-42e78ccd-c636-43e0-9c38-bc4dc85bdb09 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:56:00.192536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 317/644] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:00.199524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80379af-7dac-44c6-98ff-a2ed9c47f1e9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.211845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80379af-7dac-44c6-98ff-a2ed9c47f1e9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.217562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b69a88-23b4-4449-93e3-b879efb7f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.218672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b69a88-23b4-4449-93e3-b879efb7f0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.219153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b69a88-23b4-4449-93e3-b879efb7f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.219632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b69a88-23b4-4449-93e3-b879efb7f0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.220637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b69a88-23b4-4449-93e3-b879efb7f0eb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.221162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b69a88-23b4-4449-93e3-b879efb7f0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.223270 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b69a88-23b4-4449-93e3-b879efb7f0eb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.233461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 328/645] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:00.240320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78ccd-c636-43e0-9c38-bc4dc85bdb09 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.248073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823dc1b-ac94-44e1-8577-63dea28c7d83 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.249844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823dc1b-ac94-44e1-8577-63dea28c7d83 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.251449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823dc1b-ac94-44e1-8577-63dea28c7d83 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.255872 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e78ccd-c636-43e0-9c38-bc4dc85bdb09 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.259672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 329/646] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:00 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:00.262491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.263652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.265625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087936b0-90f0-47bf-9def-9a832bed459f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.266217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087936b0-90f0-47bf-9def-9a832bed459f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.266796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087936b0-90f0-47bf-9def-9a832bed459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.269266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.269789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.287772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.290027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.297768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-087936b0-90f0-47bf-9def-9a832bed459f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:00.299116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-087936b0-90f0-47bf-9def-9a832bed459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:00.309982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:00.312086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 318/647] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:00.314286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 330/648] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:56:00.318519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.330466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9f517-7cd6-4de5-9467-7da94e3618ae admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.336154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.337124 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.337658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.338159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.339208 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.339719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.341679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.355314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087936b0-90f0-47bf-9def-9a832bed459f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.358309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 319/649] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:00.364914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.375251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab2aa9-5eb1-4b61-a491-dc797c3588d3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.379809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.380597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.380774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087936b0-90f0-47bf-9def-9a832bed459f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.380889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.381140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.389287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.391338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.406113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:56:00.407788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.408605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.409453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.409736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.410410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.412069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.413359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 320/650] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:00.414948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.428970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041174c0-b626-499d-b91f-dd9f7b7b3936 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.433926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.434712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.434997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.435266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.436220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.436526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.438204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 11 16:56:00.438510 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.439759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 331/651] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/services/network => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:00.451555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.458962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 321/652] 10.222.0.16 () {56 vars in 1156 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:00.466526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.473315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9937b-a5a4-4427-9dde-0bbec1893719 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.477645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a4b39-55db-43c8-b833-b51607da8f8d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.482714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.483429 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.483711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.484035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.484788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] RBAC: Adding query filter params (name=network) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.485154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.486839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.495019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363c10d-4469-46e2-815f-4e652e6c5a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.496277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c10d-4469-46e2-815f-4e652e6c5a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.498218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 332/653] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/services?name=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:00.498758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c10d-4469-46e2-815f-4e652e6c5a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.499245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363c10d-4469-46e2-815f-4e652e6c5a0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.504568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.514455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363c10d-4469-46e2-815f-4e652e6c5a0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.517521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363c10d-4469-46e2-815f-4e652e6c5a0f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.524280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafe820-0ebd-4606-9a59-b32293e0590e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.531187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.532238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.532709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.533274 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.534801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.537682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 322/654] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:56:00.538215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.540119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.546581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363c10d-4469-46e2-815f-4e652e6c5a0f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.549545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 333/655] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/services?type=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:00.565656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363c10d-4469-46e2-815f-4e652e6c5a0f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.579755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.581164 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.581420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.581693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.599155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.601202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.630045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:00.636549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 323/656] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:00.637908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.658471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8d3c-648a-422c-9fb6-e79a6769d608 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.666247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.666953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.667279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.667562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.668359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.668668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.670395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.691177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 334/657] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:00.698060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.711807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c78e-1cfc-486c-857d-84df0c1ee39c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.718806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.719921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.720380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.720850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.732549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.734847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.755934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:00.762649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 324/658] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:00.764684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.780018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042201-2531-467f-9b3b-eaff192808c9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.787541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44ea6-e964-463b-87a0-2044ae2c3172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.788255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44ea6-e964-463b-87a0-2044ae2c3172 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.788533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44ea6-e964-463b-87a0-2044ae2c3172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.788803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44ea6-e964-463b-87a0-2044ae2c3172 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.789724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44ea6-e964-463b-87a0-2044ae2c3172 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.790026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44ea6-e964-463b-87a0-2044ae2c3172 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.791961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44ea6-e964-463b-87a0-2044ae2c3172 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.806635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 335/659] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:00.813888 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:00.825049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049816ef-1533-4c63-aa78-dc6574bf7f6e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:00.829688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ff599-eb98-48c1-80aa-7891e6b9ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:00.830494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff599-eb98-48c1-80aa-7891e6b9ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:00.831569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff599-eb98-48c1-80aa-7891e6b9ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:00.831990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff599-eb98-48c1-80aa-7891e6b9ae10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:00.832989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ff599-eb98-48c1-80aa-7891e6b9ae10 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=cc5d09e583e942e998f2c9808f1dc5b6) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:00.833508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ff599-eb98-48c1-80aa-7891e6b9ae10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:00.835578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ff599-eb98-48c1-80aa-7891e6b9ae10 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:00.842698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 325/660] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:00 2021] GET /identity/v3/role_assignments?user.id=cc5d09e583e942e998f2c9808f1dc5b6&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:01.813650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2775-36d7-4826-9628-10971a9ab0af None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:01.814705 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2775-36d7-4826-9628-10971a9ab0af None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:01.815271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be2775-36d7-4826-9628-10971a9ab0af None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:01.818120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 336/661] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:01.824022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98011-b7a1-4986-aeae-72edf93c6b88 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:01.824473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98011-b7a1-4986-aeae-72edf93c6b88 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:01.824558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98011-b7a1-4986-aeae-72edf93c6b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:01.846087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-28b98011-b7a1-4986-aeae-72edf93c6b88 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:01.847329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-28b98011-b7a1-4986-aeae-72edf93c6b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:01.861567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 326/662] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 11 16:56:01.912225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be2775-36d7-4826-9628-10971a9ab0af None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:01.928125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be2775-36d7-4826-9628-10971a9ab0af None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:01.933424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477545-cb4c-4809-bd07-03a5b6e95240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:01.934506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477545-cb4c-4809-bd07-03a5b6e95240 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:01.935020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477545-cb4c-4809-bd07-03a5b6e95240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:01.935577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477545-cb4c-4809-bd07-03a5b6e95240 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:01.951520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5477545-cb4c-4809-bd07-03a5b6e95240 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:01.958574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-c5477545-cb4c-4809-bd07-03a5b6e95240 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:56:01.960085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 337/663] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:56:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:01.966086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98011-b7a1-4986-aeae-72edf93c6b88 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:01.979659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98011-b7a1-4986-aeae-72edf93c6b88 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:01.986511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60b02a-d2cc-466e-8938-771ece351e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:01.987736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b02a-d2cc-466e-8938-771ece351e14 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:01.988010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b02a-d2cc-466e-8938-771ece351e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:01.988281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b02a-d2cc-466e-8938-771ece351e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:01.989305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60b02a-d2cc-466e-8938-771ece351e14 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:01.989604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60b02a-d2cc-466e-8938-771ece351e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:01.991325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60b02a-d2cc-466e-8938-771ece351e14 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.004951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 327/664] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:56:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:02.011001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477545-cb4c-4809-bd07-03a5b6e95240 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.024013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477545-cb4c-4809-bd07-03a5b6e95240 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.035137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.036007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.036350 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.036682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.056964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.059003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.063626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf250a-9de9-473f-b167-55936d3f9f3b None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.064245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf250a-9de9-473f-b167-55936d3f9f3b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.064709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf250a-9de9-473f-b167-55936d3f9f3b None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.067158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 328/665] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:02.074424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869fdb-bce3-41b6-a770-08b155449296 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.075045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869fdb-bce3-41b6-a770-08b155449296 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.075541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869fdb-bce3-41b6-a770-08b155449296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.082398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:02.084012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 338/666] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:02.091530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.112211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2853381-ca0b-4174-9cc3-906582a97165 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.113920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6b869fdb-bce3-41b6-a770-08b155449296 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:02.115409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6b869fdb-bce3-41b6-a770-08b155449296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:02.123540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.124216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.124495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.124774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.125512 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:02.125822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.127434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.137985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 329/667] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 11 16:56:02.149925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 339/668] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:02.155921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b869fdb-bce3-41b6-a770-08b155449296 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.163700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.167335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b869fdb-bce3-41b6-a770-08b155449296 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.177072 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea4c7-be3c-4daf-a708-1e456b35cea6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.180168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.181130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.181415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.181687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.187843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.188507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.188791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.189070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.189803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.191391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:02.191391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:56:02.191391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:56:02.192271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.192591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.194738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.212039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:56:02.213735 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 330/669] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:02.219992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.230569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f41d2-f990-4400-9599-c3f8799c6716 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.235579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.244907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.244907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.244907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.244907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:02.244907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.244907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.260117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 331/670] 10.222.0.16 () {56 vars in 1170 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:02.266064 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.280942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5b12a-438f-43d8-ae7e-9450274a0ef2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.286024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0392ccf-d5fe-4ed0-a491-e69977c5c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.287057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392ccf-d5fe-4ed0-a491-e69977c5c52b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.287489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392ccf-d5fe-4ed0-a491-e69977c5c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.287968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392ccf-d5fe-4ed0-a491-e69977c5c52b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.296525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392ccf-d5fe-4ed0-a491-e69977c5c52b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.298586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392ccf-d5fe-4ed0-a491-e69977c5c52b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.309580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 332/671] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 16:56:02.316705 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0392ccf-d5fe-4ed0-a491-e69977c5c52b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.321194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 340/672] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:02 2021] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:02.327001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0392ccf-d5fe-4ed0-a491-e69977c5c52b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.363588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.365037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.365472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.365902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.378036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.380316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.402532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:02.404081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 333/673] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:02.411144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.429071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c89022-7b71-4de9-8ee4-72aa749a8723 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.443378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.444250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.444623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.444991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.445852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:02.446252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.447994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.464398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 341/674] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:02.470968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.486410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8faf5c1-e59f-441a-acb3-6f206d9814f3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.494316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.495489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.495973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.496498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.512680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.515141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.538427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:02.540068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 334/675] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:02.546518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.559689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57786405-bb6e-4bb2-b73f-1e391918cd24 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.567601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893e724-bf26-4cb2-8b9b-c3691fc76e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.568323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e724-bf26-4cb2-8b9b-c3691fc76e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.568699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e724-bf26-4cb2-8b9b-c3691fc76e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.569061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893e724-bf26-4cb2-8b9b-c3691fc76e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.569951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893e724-bf26-4cb2-8b9b-c3691fc76e97 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:02.570353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893e724-bf26-4cb2-8b9b-c3691fc76e97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.572293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893e724-bf26-4cb2-8b9b-c3691fc76e97 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.585882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 342/676] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:02.592022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.607826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995afef-347b-4f7b-8cbc-3114cb4fab0f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.612988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c5f8d-6eca-4e54-a382-a869229282b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.613934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c5f8d-6eca-4e54-a382-a869229282b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.614655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c5f8d-6eca-4e54-a382-a869229282b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.615076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c5f8d-6eca-4e54-a382-a869229282b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.616078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c5f8d-6eca-4e54-a382-a869229282b0 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=c231f9d11cce4493a85d6d5129afa3a6) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:02.616550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c5f8d-6eca-4e54-a382-a869229282b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.618784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c5f8d-6eca-4e54-a382-a869229282b0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.625464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 335/677] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/role_assignments?user.id=c231f9d11cce4493a85d6d5129afa3a6&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:02.779042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd933e2a-eed0-4e72-91ae-38c3a263f34e None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.779505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd933e2a-eed0-4e72-91ae-38c3a263f34e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.779878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd933e2a-eed0-4e72-91ae-38c3a263f34e None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.781904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 343/678] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:02.788764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd50ae-d899-489f-8591-0aeb052277c1 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.789277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd50ae-d899-489f-8591-0aeb052277c1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.789699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd50ae-d899-489f-8591-0aeb052277c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.819875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-47dd50ae-d899-489f-8591-0aeb052277c1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:02.821345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-47dd50ae-d899-489f-8591-0aeb052277c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:02.830415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 336/679] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:02 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:02.860501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd933e2a-eed0-4e72-91ae-38c3a263f34e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.876277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd933e2a-eed0-4e72-91ae-38c3a263f34e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.882734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1432ead-6989-46c9-990b-a7f6bd05701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.883674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1432ead-6989-46c9-990b-a7f6bd05701e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.884048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1432ead-6989-46c9-990b-a7f6bd05701e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.884413 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1432ead-6989-46c9-990b-a7f6bd05701e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.897051 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1432ead-6989-46c9-990b-a7f6bd05701e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:02.904262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-a1432ead-6989-46c9-990b-a7f6bd05701e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:02.905848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 344/680] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:02.912459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd50ae-d899-489f-8591-0aeb052277c1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.928522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd50ae-d899-489f-8591-0aeb052277c1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.938253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.939250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.939766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.940275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:02.941242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:02.941750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:02.943612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:02.959014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 337/681] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:02.966826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1432ead-6989-46c9-990b-a7f6bd05701e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:02.983916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1432ead-6989-46c9-990b-a7f6bd05701e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:02.991579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:02.992367 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:02.992651 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:02.992925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.011821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.013681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.043511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:03.044807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 345/682] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:03.051624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.067834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5c5ff-854a-435e-a414-4d5b338486a6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.083260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.084276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.084783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.085258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.086212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:03.086807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.088628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.102062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 338/683] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:03.108332 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.126639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a019d0-7dec-49d1-b4db-598cd92f837e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.139169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.139969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.140253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.140528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.151731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.153786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.175044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:56:03.176551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 346/684] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:56:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:03.182569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.195647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cadf27-2d6c-413c-98a5-34b27f9da064 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.205402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.206366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.206870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.207349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.208385 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:03.208908 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.211030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.230816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 339/685] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:56:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:03.236749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.251423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eaad3-dcc7-4dcd-9092-2e7e03f15ef4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.258518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.259368 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.259643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.259960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.274246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.276364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.298115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:03.299950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 347/686] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:03.305772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.315863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5a62-d127-4d7b-a0c9-7d3f5e7316ad admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.326227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.327178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.327675 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.328147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.329124 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:03.329626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.331981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.344685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 340/687] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:03.351342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.362194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe610965-27bc-4854-9eb3-b3638a4034d4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.372066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.373294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.373779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.374271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.382311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.384679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.403034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:03.404505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 348/688] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:03.411639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.421648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f36de-f600-4917-8f4a-8d6cd1f3af57 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.429511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cdba-8910-43be-bdbb-872072c0cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.430412 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cdba-8910-43be-bdbb-872072c0cf58 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.430925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cdba-8910-43be-bdbb-872072c0cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.431403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cdba-8910-43be-bdbb-872072c0cf58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.432391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3cdba-8910-43be-bdbb-872072c0cf58 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:03.432917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3cdba-8910-43be-bdbb-872072c0cf58 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.435039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3cdba-8910-43be-bdbb-872072c0cf58 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.451790 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 341/689] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:03.458855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.470982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deed35a-0595-47eb-b3c8-82e5b124537f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.482728 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe14711-ed9c-478a-a452-946cb27bc80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.483905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe14711-ed9c-478a-a452-946cb27bc80e admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.484386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe14711-ed9c-478a-a452-946cb27bc80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.484866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe14711-ed9c-478a-a452-946cb27bc80e admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/0941777cfcbf4532be31ca001ced8aa7/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.487139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe14711-ed9c-478a-a452-946cb27bc80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=0941777cfcbf4532be31ca001ced8aa7, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.490265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe14711-ed9c-478a-a452-946cb27bc80e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.539184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e792292-2bc6-4f6c-9921-9cb363ec4588 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.539504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e792292-2bc6-4f6c-9921-9cb363ec4588 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.539739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e792292-2bc6-4f6c-9921-9cb363ec4588 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.541841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 342/690] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:56:03.547665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec074a-0fdb-456f-a3bd-47ac16e0eb17 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.547954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec074a-0fdb-456f-a3bd-47ac16e0eb17 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.548244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec074a-0fdb-456f-a3bd-47ac16e0eb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.566900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 349/691] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:56:03 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/0941777cfcbf4532be31ca001ced8aa7/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:56:03.573017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-31ec074a-0fdb-456f-a3bd-47ac16e0eb17 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:03.574294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-31ec074a-0fdb-456f-a3bd-47ac16e0eb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:03.647236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 343/692] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:03 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:03.668881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe14711-ed9c-478a-a452-946cb27bc80e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:03.679882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe14711-ed9c-478a-a452-946cb27bc80e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:03.686859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fd696-aff7-4649-b4c4-8ed80f7f3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:03.687590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd696-aff7-4649-b4c4-8ed80f7f3748 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:03.687874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd696-aff7-4649-b4c4-8ed80f7f3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:03.688145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fd696-aff7-4649-b4c4-8ed80f7f3748 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:03.688947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fd696-aff7-4649-b4c4-8ed80f7f3748 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:03.691194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fd696-aff7-4649-b4c4-8ed80f7f3748 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:03.761273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 350/693] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:03 2021] POST /identity/v3/services => generated 240 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:04.227653 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96781de8-a188-493f-8d48-246a57930389 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.228158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96781de8-a188-493f-8d48-246a57930389 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.228232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96781de8-a188-493f-8d48-246a57930389 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.230165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 344/694] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:04.236509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cafdf-8570-4f53-b2c0-f31c68b9431e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.237618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cafdf-8570-4f53-b2c0-f31c68b9431e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.237618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cafdf-8570-4f53-b2c0-f31c68b9431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.257124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dd4cafdf-8570-4f53-b2c0-f31c68b9431e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:04.258325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dd4cafdf-8570-4f53-b2c0-f31c68b9431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:04.279797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 351/695] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:04 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:04.318876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96781de8-a188-493f-8d48-246a57930389 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.336436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96781de8-a188-493f-8d48-246a57930389 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.341481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dc6c3-5019-4771-95fd-26168f0bee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.342280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc6c3-5019-4771-95fd-26168f0bee2c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.342569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc6c3-5019-4771-95fd-26168f0bee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.342859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc6c3-5019-4771-95fd-26168f0bee2c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.361662 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dc6c3-5019-4771-95fd-26168f0bee2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:04.369792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-ff0dc6c3-5019-4771-95fd-26168f0bee2c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:04.371200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 345/696] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:04.378108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cafdf-8570-4f53-b2c0-f31c68b9431e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.392453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cafdf-8570-4f53-b2c0-f31c68b9431e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.398052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.398850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.399130 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.399582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.400395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:04.400696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.402290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.413939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 352/697] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:04.420393 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dc6c3-5019-4771-95fd-26168f0bee2c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.432168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dc6c3-5019-4771-95fd-26168f0bee2c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.437513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.438348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.438656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.438929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.455975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.458561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.486508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:04.488788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 346/698] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:04.495869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.509193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4a801-1ca4-4395-894b-9098c0b4676a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.513974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.514702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.514987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.515311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.516090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:04.516389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.518037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.534359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 353/699] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:04.541616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.553523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6409ba-75ec-4ae6-9cef-858d981671b9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.559747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.560586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.560864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.561188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.572324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.574428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.594178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:56:04.595714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 347/700] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/users/swift => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:04.602321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.617884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e373-3d94-4ddc-8e7b-191fe96592f2 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.624998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.625721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.625999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.626272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.627184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:04.627525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.629475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.656078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 354/701] 10.222.0.16 () {56 vars in 1156 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:04.662867 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.676259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a747c6-4187-48f9-a969-c64e2d56b7d0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.684434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49e55-3c59-4af2-9296-01bdd03579f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.684434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49e55-3c59-4af2-9296-01bdd03579f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.684434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49e55-3c59-4af2-9296-01bdd03579f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.684434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49e55-3c59-4af2-9296-01bdd03579f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.698149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49e55-3c59-4af2-9296-01bdd03579f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.700213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49e55-3c59-4af2-9296-01bdd03579f0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.709836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 348/702] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:04.717380 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.732970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fe786-d313-4cd4-8bf0-3e6f7de554da admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.747276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.748099 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.748376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.748742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.763435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.765336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.793871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:04.795488 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 355/703] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:04.801768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49e55-3c59-4af2-9296-01bdd03579f0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.811081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49e55-3c59-4af2-9296-01bdd03579f0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.822287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.823246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.823829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.824355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.825289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:04.825806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.827645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.849788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 349/704] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:04.857081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.870105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc4f6b-e72e-4233-b01b-0db5089facfc admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.879093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.879905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.880182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.880452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.895707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.897699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.918442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:04.922921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 356/705] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:04.926986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:04.939584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779dafac-8f75-49dd-bd73-41ef880b9f53 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:04.953169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e827452-5666-4cf6-8fa0-dce12f3bf424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:04.954123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e827452-5666-4cf6-8fa0-dce12f3bf424 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:04.954633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e827452-5666-4cf6-8fa0-dce12f3bf424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:04.955105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e827452-5666-4cf6-8fa0-dce12f3bf424 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:04.956120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e827452-5666-4cf6-8fa0-dce12f3bf424 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:04.956623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e827452-5666-4cf6-8fa0-dce12f3bf424 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:04.958681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e827452-5666-4cf6-8fa0-dce12f3bf424 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:04.978746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 350/706] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:04.985583 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.001363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a31a9-0dd7-4606-a970-99112255e063 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.017201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bcaeb-3203-402a-87b3-880e1defba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.017867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcaeb-3203-402a-87b3-880e1defba84 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.018693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcaeb-3203-402a-87b3-880e1defba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.018972 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bcaeb-3203-402a-87b3-880e1defba84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.019826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bcaeb-3203-402a-87b3-880e1defba84 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=cc5d09e583e942e998f2c9808f1dc5b6) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:05.020134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bcaeb-3203-402a-87b3-880e1defba84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.021973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bcaeb-3203-402a-87b3-880e1defba84 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.028423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 357/707] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:04 2021] GET /identity/v3/role_assignments?user.id=cc5d09e583e942e998f2c9808f1dc5b6&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:05.398126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03b54-896e-4ed3-91de-2c926aebef72 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.399166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03b54-896e-4ed3-91de-2c926aebef72 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.399684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f03b54-896e-4ed3-91de-2c926aebef72 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.401906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 351/708] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:05.408487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1064-3859-4001-8ae5-843469fbfd14 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.409392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1064-3859-4001-8ae5-843469fbfd14 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.409870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1064-3859-4001-8ae5-843469fbfd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.434428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ed9c1064-3859-4001-8ae5-843469fbfd14 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:05.436008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ed9c1064-3859-4001-8ae5-843469fbfd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:05.451030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 358/709] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:05 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:05.495780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f03b54-896e-4ed3-91de-2c926aebef72 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.515234 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f03b54-896e-4ed3-91de-2c926aebef72 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.520248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635f7d-5ccc-4bb1-a6c6-40dd9cfd4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.521286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635f7d-5ccc-4bb1-a6c6-40dd9cfd4940 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.521797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635f7d-5ccc-4bb1-a6c6-40dd9cfd4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.522273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635f7d-5ccc-4bb1-a6c6-40dd9cfd4940 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.541263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c635f7d-5ccc-4bb1-a6c6-40dd9cfd4940 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:05.549020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-7c635f7d-5ccc-4bb1-a6c6-40dd9cfd4940 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:56:05.555172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 352/710] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:05.561735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c1064-3859-4001-8ae5-843469fbfd14 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.571839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c1064-3859-4001-8ae5-843469fbfd14 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.582724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44764295-8743-41d3-9774-d9abb6c52fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.583662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764295-8743-41d3-9774-d9abb6c52fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.584148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764295-8743-41d3-9774-d9abb6c52fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.584653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764295-8743-41d3-9774-d9abb6c52fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.585609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44764295-8743-41d3-9774-d9abb6c52fb1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:05.586113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44764295-8743-41d3-9774-d9abb6c52fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.587960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44764295-8743-41d3-9774-d9abb6c52fb1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.602107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 359/711] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:05.610010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635f7d-5ccc-4bb1-a6c6-40dd9cfd4940 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.621007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c635f7d-5ccc-4bb1-a6c6-40dd9cfd4940 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.625968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.627057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.628122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.628600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.632901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61062f13-e187-42ea-8020-68077ddff8ff None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.633191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61062f13-e187-42ea-8020-68077ddff8ff None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.633471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61062f13-e187-42ea-8020-68077ddff8ff None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.635531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 360/712] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:56:05.641154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.641621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e79bd-db17-4e04-b969-d22c7faa11a9 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.641909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e79bd-db17-4e04-b969-d22c7faa11a9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.642187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e79bd-db17-4e04-b969-d22c7faa11a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.644070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.660483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b55e79bd-db17-4e04-b969-d22c7faa11a9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:05.661596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b55e79bd-db17-4e04-b969-d22c7faa11a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:05.663229 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:05.665089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 353/713] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:05.669884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 361/714] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:05 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:05.671819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.682436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df91fe-fe52-4226-bafe-6ce8ba782806 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.687328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.688211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.688695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.689212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.690734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:05.691248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.693067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.694978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e79bd-db17-4e04-b969-d22c7faa11a9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.704220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e79bd-db17-4e04-b969-d22c7faa11a9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.706499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 354/715] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:05.712791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.714900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.715808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.716092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.716400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.717077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.718896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.725621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd193-64de-4ed9-8928-be8c4723ea21 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.730604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.731772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.732275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 11 16:56:05.732523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.733002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.733779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 362/716] 10.222.0.16 () {56 vars in 1150 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:05.743887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.746275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.748638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.754938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50948-8fcb-401d-b179-70e3337d2eb1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.759711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.760353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.760631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.760911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.761618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:05.761927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.763531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.768360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 363/717] 10.222.0.16 () {56 vars in 1145 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:05.768682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:56:05.770447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 355/718] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:05.775826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.777013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.787096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebebfd4-7715-42d4-9b93-c4e6dda37bcd admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.787923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4553-9eec-4154-aae6-60ad6115a3c1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.791902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.792604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.792887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.793164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.793929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:05.794237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.794495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.795365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.795829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.795994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.796471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.797702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:05.798599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.801435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.802007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 364/719] 10.222.0.16 () {56 vars in 1145 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:05.809156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.820435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921534c6-dcf0-40e1-b8cb-fe0164a71902 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.831102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 356/720] 10.222.0.16 () {56 vars in 1170 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:05.836924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.840224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.840905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.841191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.841465 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.842272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] RBAC: Adding query filter params (interface=public, service_id=9482961ae0f54bc9b91a1ad6684fa440, region_id=RegionOne) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:05.842598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.850266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:05.850266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:56:05.850266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:56:05.850266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.852914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76f44-96fe-4167-b3f6-c68c6566b02a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.858166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 365/721] 10.222.0.16 () {56 vars in 1272 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/endpoints?service_id=9482961ae0f54bc9b91a1ad6684fa440&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:05.865483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.866271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.866577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.866859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.869819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.885287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.887207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.888731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe95bc-e912-4525-b9f5-54a43da645db admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.904758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:05.906255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 357/722] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:05.907211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79eea0-f209-4002-8040-ee7a50bde400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.907874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79eea0-f209-4002-8040-ee7a50bde400 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.908153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79eea0-f209-4002-8040-ee7a50bde400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.908427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79eea0-f209-4002-8040-ee7a50bde400 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.909644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79eea0-f209-4002-8040-ee7a50bde400 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.913536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79eea0-f209-4002-8040-ee7a50bde400 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.914405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.921743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 366/723] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/services => generated 772 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:05.936915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6447cb-4340-4d7e-aa30-4bc4054ec244 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.942065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.942901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.943338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.943712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:05.944598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:05.945002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:05.946759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:05.965037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 358/724] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:05.972137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79eea0-f209-4002-8040-ee7a50bde400 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:05.984000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79eea0-f209-4002-8040-ee7a50bde400 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:05.990440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:05.991391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:05.991672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:05.992004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.001625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.003745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.018378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:06.020169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 367/725] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:06.027669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.038927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03818dd-bd42-4be9-9c56-955d229a9c8e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.048609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd046ec1-72b3-412c-8e00-e2d73b4d2e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.049386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046ec1-72b3-412c-8e00-e2d73b4d2e63 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.050166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046ec1-72b3-412c-8e00-e2d73b4d2e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.050443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046ec1-72b3-412c-8e00-e2d73b4d2e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.051338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd046ec1-72b3-412c-8e00-e2d73b4d2e63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:06.051654 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd046ec1-72b3-412c-8e00-e2d73b4d2e63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.053797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd046ec1-72b3-412c-8e00-e2d73b4d2e63 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.073443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 359/726] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:06.080345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.096332 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436b86b-a77a-41cc-bfa7-15704915749a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.102439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c2537-099f-442d-95e3-c77221de4360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.103433 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2537-099f-442d-95e3-c77221de4360 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.103717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2537-099f-442d-95e3-c77221de4360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.103998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2537-099f-442d-95e3-c77221de4360 admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/c231f9d11cce4493a85d6d5129afa3a6/roles/d9aae4994e18459dae9fd6b22e704d75` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.124889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c2537-099f-442d-95e3-c77221de4360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=c231f9d11cce4493a85d6d5129afa3a6, role_id=d9aae4994e18459dae9fd6b22e704d75)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.128285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c2537-099f-442d-95e3-c77221de4360 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.220557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 368/727] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:56:06 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/c231f9d11cce4493a85d6d5129afa3a6/roles/d9aae4994e18459dae9fd6b22e704d75 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:56:06.411940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9672-0511-4abc-93cc-d9790ebc8135 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.412646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9672-0511-4abc-93cc-d9790ebc8135 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.412646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d9672-0511-4abc-93cc-d9790ebc8135 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.414741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 360/728] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:06.421486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170daea-0955-4bc0-b904-eedfc99e226f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.422137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170daea-0955-4bc0-b904-eedfc99e226f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.422137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170daea-0955-4bc0-b904-eedfc99e226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.447694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0170daea-0955-4bc0-b904-eedfc99e226f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:06.449028 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0170daea-0955-4bc0-b904-eedfc99e226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:06.522899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 369/729] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:06.549475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d9672-0511-4abc-93cc-d9790ebc8135 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.563180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d9672-0511-4abc-93cc-d9790ebc8135 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.573938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f854-d488-4445-acc8-aa6219d9bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.574749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f854-d488-4445-acc8-aa6219d9bdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.575026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f854-d488-4445-acc8-aa6219d9bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.575294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f854-d488-4445-acc8-aa6219d9bdb2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.586973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98f854-d488-4445-acc8-aa6219d9bdb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:06.593890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-4b98f854-d488-4445-acc8-aa6219d9bdb2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:06.595398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 361/730] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:06.602374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170daea-0955-4bc0-b904-eedfc99e226f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.612215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170daea-0955-4bc0-b904-eedfc99e226f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.617144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.617794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.618069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.618338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.619118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:06.619416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.621006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.631803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 370/731] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:06.637753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f854-d488-4445-acc8-aa6219d9bdb2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.648204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f854-d488-4445-acc8-aa6219d9bdb2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.652751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.653524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.653803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.654071 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.673119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.675202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.694093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:06.695695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 362/732] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:06.701890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.713266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3272a-2ee5-47e3-95aa-43aa01227e97 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.718135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.718869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.719186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.719462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.720293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:06.720602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.722447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.736924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 371/733] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:06.743317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.754359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f35dc-a4d2-403c-b7ed-a918bb959038 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.759167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.759986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.760301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.760575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.769960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.772221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.786740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:56:06.788207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 363/734] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:06.794356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.804877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2c13-07c0-4d40-8a3c-ffb0edfe4965 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.809808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.810527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.810826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.811058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.811978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:06.812288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.814162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.837979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 372/735] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:06.844158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.859676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c7143-7d85-44e5-9855-00631305ef59 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.868556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95499c8-5624-4d26-961c-bbf3272627df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.869203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95499c8-5624-4d26-961c-bbf3272627df admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.869485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95499c8-5624-4d26-961c-bbf3272627df admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.869761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95499c8-5624-4d26-961c-bbf3272627df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.880475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95499c8-5624-4d26-961c-bbf3272627df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.882232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95499c8-5624-4d26-961c-bbf3272627df admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.896819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 364/736] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:06.903130 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:06.909865 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0d6d-63cd-41be-ab50-b0be9f10e8cd None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.910148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0d6d-63cd-41be-ab50-b0be9f10e8cd None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.910423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0d6d-63cd-41be-ab50-b0be9f10e8cd None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.915734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f876c-847f-43ac-853e-5dc16d0b5c1d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:06.918409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 365/737] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:06 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:06.921781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:06.922597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.924509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ee030-ed67-4e95-ad13-c82c2b8a590c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:06.924791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ee030-ed67-4e95-ad13-c82c2b8a590c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.925067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ee030-ed67-4e95-ad13-c82c2b8a590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.926394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:06.926734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:06.947464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:06.949334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:06.957595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-8f8ee030-ed67-4e95-ad13-c82c2b8a590c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:06.958846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8f8ee030-ed67-4e95-ad13-c82c2b8a590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:06.981701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 366/738] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:06 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:06.981929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:06.983331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 373/739] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:06.990343 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ee030-ed67-4e95-ad13-c82c2b8a590c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.000120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ee030-ed67-4e95-ad13-c82c2b8a590c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.005318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.006048 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.006401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.006749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.007491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:07.007802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.009398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.021973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 367/740] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:07.028300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.028438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.037954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fb7c4-c888-4ef3-913a-063c4625c587 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.041273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1468b1c-b2cf-4d8a-9c30-ad7e2ab75d64 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.045126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.045126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.045126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.045126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.051489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.053525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.057335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.058129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.058408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.058709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] PATH_INFO: `/v3/services/network` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.059376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.060959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.075464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:07.077073 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 368/741] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:07.083584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.088253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 11 16:56:07.094761 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 374/742] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:07 2021] GET /identity/v3/services/network => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:07.099154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.101529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed300cf9-f439-438f-a852-a529184623ba admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.116663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da551a5-3551-4ff9-91d7-aa6e6ddda79f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.121205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.121961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.122282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.122617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.123421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:07.123734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.125656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.137340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.138368 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.138677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.140463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.141183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:07.141485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.144308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.147015 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 369/743] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:07.154472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.159475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 375/744] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:07 2021] GET /identity/v3/services?name=network => generated 124 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:07.166918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.170168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1f0ae-736c-4f22-895a-7b0bd9d4915a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.178397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c2e1c-0b4e-478f-8832-ede51c94ec17 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.183148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.183957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.184233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.184504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.185296 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:07.185596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.187545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.191233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.191901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.192175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.192457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.193309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=0941777cfcbf4532be31ca001ced8aa7) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:07.193619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.193924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 376/745] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:07 2021] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:07.196190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.200051 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.209764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 370/746] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:07 2021] GET /identity/v3/role_assignments?user.id=0941777cfcbf4532be31ca001ced8aa7&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:07.218392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436d70d-c7f3-444b-97d2-bfdd6d9f07d3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.226326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f230a-d744-491b-9873-31fa7cf5eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.227349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f230a-d744-491b-9873-31fa7cf5eacb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.227807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f230a-d744-491b-9873-31fa7cf5eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.228328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f230a-d744-491b-9873-31fa7cf5eacb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.229400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f230a-d744-491b-9873-31fa7cf5eacb admin admin] RBAC: Adding query filter params (interface=public, service_id=5ba78dc709824e7c835d5cec529ce634, region_id=RegionOne) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:07.229927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f230a-d744-491b-9873-31fa7cf5eacb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.231870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f230a-d744-491b-9873-31fa7cf5eacb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.240006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 377/747] 10.222.0.16 () {56 vars in 1272 bytes} [Thu Nov 11 16:56:07 2021] GET /identity/v3/endpoints?service_id=5ba78dc709824e7c835d5cec529ce634&interface=public®ion_id=RegionOne => generated 194 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:07.246011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:07.257038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc3794-9464-43ca-b066-cc1914fec9a7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:07.266971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efce84-f791-43e3-93da-d100b1a02a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:07.267982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efce84-f791-43e3-93da-d100b1a02a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:07.268993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efce84-f791-43e3-93da-d100b1a02a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:07.269440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efce84-f791-43e3-93da-d100b1a02a1b admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:07.270345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efce84-f791-43e3-93da-d100b1a02a1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:07.272289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efce84-f791-43e3-93da-d100b1a02a1b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:07.278828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 371/748] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:56:07 2021] GET /identity/v3/services => generated 772 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:08.067056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af48ff-3fe6-4475-98c2-9ac43191c1f1 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.068064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af48ff-3fe6-4475-98c2-9ac43191c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.068540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af48ff-3fe6-4475-98c2-9ac43191c1f1 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.070844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 378/749] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:08.076561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230729c-f648-4e4d-b62d-093b7c905097 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.077408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230729c-f648-4e4d-b62d-093b7c905097 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.077875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230729c-f648-4e4d-b62d-093b7c905097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.103554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7230729c-f648-4e4d-b62d-093b7c905097 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:08.105057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7230729c-f648-4e4d-b62d-093b7c905097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:08.119447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 372/750] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:08.150664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af48ff-3fe6-4475-98c2-9ac43191c1f1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.166889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af48ff-3fe6-4475-98c2-9ac43191c1f1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.176361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64df53-8669-4e44-a7f8-4c7ef519707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.177184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64df53-8669-4e44-a7f8-4c7ef519707e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.177522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64df53-8669-4e44-a7f8-4c7ef519707e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.177794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64df53-8669-4e44-a7f8-4c7ef519707e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.191587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64df53-8669-4e44-a7f8-4c7ef519707e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:08.198815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-fa64df53-8669-4e44-a7f8-4c7ef519707e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:08.200639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 379/751] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:08.206901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230729c-f648-4e4d-b62d-093b7c905097 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.216391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230729c-f648-4e4d-b62d-093b7c905097 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.226348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.227078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.227355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.227626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.228391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:08.228693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.230334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.245075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 373/752] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:08.252358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64df53-8669-4e44-a7f8-4c7ef519707e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.262397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64df53-8669-4e44-a7f8-4c7ef519707e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.275145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.276207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.276685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.277149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.288741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.290856 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.320677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:08.322241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 380/753] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:08.328552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.343946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd609aa-c1eb-4d76-8aa1-f367912fc214 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.354089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.354808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.355088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.355358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.356149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:08.356451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.358084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.375784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 374/754] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:08.381961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.394035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d6303-265f-44aa-85ff-f4c8282ba967 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.407247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.408401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.409404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.409875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.418208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.420567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.441249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:56:08.443149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 381/755] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:08.449161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.467410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1155e-1b2f-4577-bedc-8ae0c3899e4d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.472630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.473388 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.473669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.473941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.474847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:08.475153 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.477081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.511068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 375/756] 10.222.0.16 () {56 vars in 1156 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:08.517119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.533245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c7c4-1527-4ce8-913d-fba2f86af3df admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.543233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.544386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.544882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.545347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.556645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.566879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.585942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:08.587434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 382/757] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:08.594529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.606045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82171-eb2b-46d9-9025-b2e8bb71caba admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.621095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ddb72-30bf-4f51-abd7-e0057ba4af3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.621817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ddb72-30bf-4f51-abd7-e0057ba4af3e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.622098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ddb72-30bf-4f51-abd7-e0057ba4af3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.622370 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ddb72-30bf-4f51-abd7-e0057ba4af3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.623132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ddb72-30bf-4f51-abd7-e0057ba4af3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:08.623482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ddb72-30bf-4f51-abd7-e0057ba4af3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.625102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ddb72-30bf-4f51-abd7-e0057ba4af3e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.641703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 376/758] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:08.648230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.664143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8143d-3087-4cfb-89d9-4d5c4d60f3e2 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.668659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4cf0-3ca9-4c61-a143-e1a3812e7c0c None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.669038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4cf0-3ca9-4c61-a143-e1a3812e7c0c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.669461 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4cf0-3ca9-4c61-a143-e1a3812e7c0c None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.670868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.671662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.671946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.672066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 377/759] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:56:08.672276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.684230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.684561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeea82-b21b-4db3-8f11-d56922648cd4 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.684851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeea82-b21b-4db3-8f11-d56922648cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.685124 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeea82-b21b-4db3-8f11-d56922648cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.686216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.699942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:08.701452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 383/760] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:08.708322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.715558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-27eeea82-b21b-4db3-8f11-d56922648cd4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:08.716780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-27eeea82-b21b-4db3-8f11-d56922648cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:08.719406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e8ca-5bfa-4430-a234-13d2f590a1f0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.724844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.725681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.726264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.726741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.727768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:08.728295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.730373 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.738587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 378/761] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:08 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:08.752615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 384/762] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:08.758816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeea82-b21b-4db3-8f11-d56922648cd4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.767375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.776986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeea82-b21b-4db3-8f11-d56922648cd4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.779354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6c75-2116-4ef2-b214-7c7731f95ec4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.784922 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.785985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.786445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.786960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.788114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.788693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8cef9-4896-4ad3-acda-2eaa7fa67308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.789577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8cef9-4896-4ad3-acda-2eaa7fa67308 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.789853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8cef9-4896-4ad3-acda-2eaa7fa67308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.790122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8cef9-4896-4ad3-acda-2eaa7fa67308 admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/cc5d09e583e942e998f2c9808f1dc5b6/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.790956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.795884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8cef9-4896-4ad3-acda-2eaa7fa67308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=cc5d09e583e942e998f2c9808f1dc5b6, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.798568 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8cef9-4896-4ad3-acda-2eaa7fa67308 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.804071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 11 16:56:08.805774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 385/763] 10.222.0.16 () {56 vars in 1150 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:08.814606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.825330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca206840-95d7-44bd-bcd9-42fb530c43a9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.830357 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.831757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.832206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.832637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.833486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:08.833931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.835769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.841385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 386/764] 10.222.0.16 () {56 vars in 1145 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:08.848216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.858618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab9087-20f5-43fe-b4a1-eaba53fe83a9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.863637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.864808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.865258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.865675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.866605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:08.867064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.868910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.878916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 387/765] 10.222.0.16 () {56 vars in 1145 bytes} [Thu Nov 11 16:56:08 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:08.881627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:08.891788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4c5a-4fd8-4caf-9586-8ac2c653ef95 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:08.897149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2f4c0-f33d-4cee-9b5a-f7d2a8215129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:08.905207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2f4c0-f33d-4cee-9b5a-f7d2a8215129 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:08.905207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2f4c0-f33d-4cee-9b5a-f7d2a8215129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:08.905207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2f4c0-f33d-4cee-9b5a-f7d2a8215129 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:08.905207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2f4c0-f33d-4cee-9b5a-f7d2a8215129 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:08.905207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-71d2f4c0-f33d-4cee-9b5a-f7d2a8215129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:08.905207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:56:08.905207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:56:08.905754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2f4c0-f33d-4cee-9b5a-f7d2a8215129 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:08.949955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 379/766] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:56:08 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/cc5d09e583e942e998f2c9808f1dc5b6/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:56:09.075180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 388/767] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:56:08 2021] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:56:09.135128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b10417-b91f-4a76-93b3-4d55c4cec02c None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.135620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b10417-b91f-4a76-93b3-4d55c4cec02c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.135620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b10417-b91f-4a76-93b3-4d55c4cec02c None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.137630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 380/768] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:09.144769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60402-c808-4af2-a3e7-1ed0f1924f16 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.145056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60402-c808-4af2-a3e7-1ed0f1924f16 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.145328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60402-c808-4af2-a3e7-1ed0f1924f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.164231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-68b60402-c808-4af2-a3e7-1ed0f1924f16 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:09.165485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-68b60402-c808-4af2-a3e7-1ed0f1924f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:09.255788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 389/769] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:09 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:09.282088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b10417-b91f-4a76-93b3-4d55c4cec02c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.295685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b10417-b91f-4a76-93b3-4d55c4cec02c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.300733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7834ebc-64c1-4d7e-b24f-a530052a4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.301544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7834ebc-64c1-4d7e-b24f-a530052a4f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.301819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7834ebc-64c1-4d7e-b24f-a530052a4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.302148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7834ebc-64c1-4d7e-b24f-a530052a4f77 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.314769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7834ebc-64c1-4d7e-b24f-a530052a4f77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:09.322800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c7834ebc-64c1-4d7e-b24f-a530052a4f77 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:56:09.324391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 381/770] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:09.331191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60402-c808-4af2-a3e7-1ed0f1924f16 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.341732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60402-c808-4af2-a3e7-1ed0f1924f16 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.346737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.347436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.347716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.347987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.348832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:09.349166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.350987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.363118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 390/771] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:09.373022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7834ebc-64c1-4d7e-b24f-a530052a4f77 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.384293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7834ebc-64c1-4d7e-b24f-a530052a4f77 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.388904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.390559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.390559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.390559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.403116 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.404954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.432425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:09.433955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 382/772] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:09.441065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.451304 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7bad6-62b1-4c8e-a6f9-450b16911388 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.455895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.456567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.456852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.457131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.457872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:09.458180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.459965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.473697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 391/773] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:09.480405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.492043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f881f-5ea6-4388-a478-61634cca3c1b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.496796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.497658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.497984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.498261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.506990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.509017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.524235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:56:09.525690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 383/774] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:09.531917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.541988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629465b6-6413-4021-b5f2-13296dbce318 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.546621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.547290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.547628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.547908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.548813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:09.549122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.551701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.572491 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 392/775] 10.222.0.16 () {56 vars in 1170 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:09.578972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.588962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891d31b-58f5-4612-8ff9-385b599c1771 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.593476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f05fae-5339-4357-a63e-e5b95a049536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.594175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f05fae-5339-4357-a63e-e5b95a049536 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.594463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f05fae-5339-4357-a63e-e5b95a049536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.594831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f05fae-5339-4357-a63e-e5b95a049536 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.605119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f05fae-5339-4357-a63e-e5b95a049536 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.607032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f05fae-5339-4357-a63e-e5b95a049536 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.617424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 384/776] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/auth/tokens => generated 1303 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:09.623606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.633789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f92415-1c37-4648-8c0b-c382e8c1621e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.638364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.639257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.639537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.639877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.652537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.654482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.673039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:09.675097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 393/777] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:09.681347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f05fae-5339-4357-a63e-e5b95a049536 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.690354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f05fae-5339-4357-a63e-e5b95a049536 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.695016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.695664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.695945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.696221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.697009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:09.697350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.698972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.711121 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 385/778] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:09.718924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.729887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c00a3c-4c44-470d-92f1-d3b7e4c65a06 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.734421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.735310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.735642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.735913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.744338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.746359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.760112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:09.761605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 394/779] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:09.772452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.782954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c64a-4c65-411f-9710-132e8924e76a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.791301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02174b-2ef4-4a52-b9df-a1919a4e3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.792401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02174b-2ef4-4a52-b9df-a1919a4e3b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.792401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02174b-2ef4-4a52-b9df-a1919a4e3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.792666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02174b-2ef4-4a52-b9df-a1919a4e3b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.793424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02174b-2ef4-4a52-b9df-a1919a4e3b4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:09.793734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02174b-2ef4-4a52-b9df-a1919a4e3b4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.796553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02174b-2ef4-4a52-b9df-a1919a4e3b4c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.815903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 386/780] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:09.822535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:09.833748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61245718-c580-4c27-aba7-c0dc1660dbb1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:09.842641 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af685e-0567-4ecf-86d3-51b63a17aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:09.843306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af685e-0567-4ecf-86d3-51b63a17aafc admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:09.843645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af685e-0567-4ecf-86d3-51b63a17aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:09.843926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af685e-0567-4ecf-86d3-51b63a17aafc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:09.844823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af685e-0567-4ecf-86d3-51b63a17aafc admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=c231f9d11cce4493a85d6d5129afa3a6) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:09.845132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af685e-0567-4ecf-86d3-51b63a17aafc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:09.847807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af685e-0567-4ecf-86d3-51b63a17aafc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:09.861291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 395/781] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:09 2021] GET /identity/v3/role_assignments?user.id=c231f9d11cce4493a85d6d5129afa3a6&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:10.214510 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305848c-f91c-470c-8950-cab7899ac33e None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.215047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305848c-f91c-470c-8950-cab7899ac33e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.215047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305848c-f91c-470c-8950-cab7899ac33e None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.217065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 387/782] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:10.223300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db173-2d24-4a81-bec5-688920c84e28 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.224143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db173-2d24-4a81-bec5-688920c84e28 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.224634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673db173-2d24-4a81-bec5-688920c84e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.247738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-673db173-2d24-4a81-bec5-688920c84e28 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:10.249244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-673db173-2d24-4a81-bec5-688920c84e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:10.261402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 396/783] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:10 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:10.287868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305848c-f91c-470c-8950-cab7899ac33e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:10.303074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305848c-f91c-470c-8950-cab7899ac33e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:10.307428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:10.308216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.308495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.308768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.309430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:10.310435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:10.310435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:56:10.310435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:56:10.311333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:10.327384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 11 16:56:10.328870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 388/784] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:10 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:10.337386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db173-2d24-4a81-bec5-688920c84e28 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:10.347855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673db173-2d24-4a81-bec5-688920c84e28 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:10.352408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:10.353067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.353347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.353622 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.354337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:10.354664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:10.356301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:10.362613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 397/785] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:10 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:10.369323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:10.382241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752af31-75f0-47d0-8fc8-f7b3539b9b38 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:10.391060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c39a3c-f68b-4e06-95b8-63f81ed2d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:10.392129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39a3c-f68b-4e06-95b8-63f81ed2d06c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.392677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39a3c-f68b-4e06-95b8-63f81ed2d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.393703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39a3c-f68b-4e06-95b8-63f81ed2d06c admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.394742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c39a3c-f68b-4e06-95b8-63f81ed2d06c admin admin] RBAC: Adding query filter params (type=network) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:10.395546 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c39a3c-f68b-4e06-95b8-63f81ed2d06c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:10.399055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c39a3c-f68b-4e06-95b8-63f81ed2d06c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:10.413747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 389/786] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:10 2021] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:10.420101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:10.431013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d653a5-48cf-41ba-bf21-69403a52dd31 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:10.438366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ed356-ea38-4a78-9360-e30b95d4ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:10.439301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ed356-ea38-4a78-9360-e30b95d4ca1d admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.440316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ed356-ea38-4a78-9360-e30b95d4ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.440797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ed356-ea38-4a78-9360-e30b95d4ca1d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.441745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ed356-ea38-4a78-9360-e30b95d4ca1d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:10.443563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ed356-ea38-4a78-9360-e30b95d4ca1d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:10.531949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 398/787] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:56:10 2021] POST /identity/v3/endpoints => generated 327 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:10.536692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e895d4-6a16-406a-9479-84542cb84516 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.537389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e895d4-6a16-406a-9479-84542cb84516 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.537875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e895d4-6a16-406a-9479-84542cb84516 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.540097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 390/788] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:10.547391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5943d-ffe6-4180-a92c-2b2198a7c62a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.547741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5943d-ffe6-4180-a92c-2b2198a7c62a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.547933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5943d-ffe6-4180-a92c-2b2198a7c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.572317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-fcf5943d-ffe6-4180-a92c-2b2198a7c62a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:10.573504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-fcf5943d-ffe6-4180-a92c-2b2198a7c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:10.602134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 399/789] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:10 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:10.639809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e895d4-6a16-406a-9479-84542cb84516 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:10.657387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e895d4-6a16-406a-9479-84542cb84516 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:10.667421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:10.668581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.669065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.669539 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.670427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:10.672254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:10.685623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 11 16:56:10.687620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 391/790] 10.222.0.16 () {56 vars in 1153 bytes} [Thu Nov 11 16:56:10 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:10.695540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5943d-ffe6-4180-a92c-2b2198a7c62a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:10.707828 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5943d-ffe6-4180-a92c-2b2198a7c62a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:10.718827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea32dd-94ab-4dad-a29c-67ff9410d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:10.719500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea32dd-94ab-4dad-a29c-67ff9410d5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.719776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea32dd-94ab-4dad-a29c-67ff9410d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.720049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea32dd-94ab-4dad-a29c-67ff9410d5b0 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.720771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea32dd-94ab-4dad-a29c-67ff9410d5b0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:10.721581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea32dd-94ab-4dad-a29c-67ff9410d5b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:10.723218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea32dd-94ab-4dad-a29c-67ff9410d5b0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:10.735162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 400/791] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:10 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:10.742071 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:10.756149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addc732-3f76-4ac8-a86c-038c2fda9fa1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:10.763401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc571f-80a4-4959-83ec-32af0217c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:10.764421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc571f-80a4-4959-83ec-32af0217c8fd admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:10.764908 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc571f-80a4-4959-83ec-32af0217c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:10.765429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc571f-80a4-4959-83ec-32af0217c8fd admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:10.766358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc571f-80a4-4959-83ec-32af0217c8fd admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:10.766905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc571f-80a4-4959-83ec-32af0217c8fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:10.769293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc571f-80a4-4959-83ec-32af0217c8fd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:10.778604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 392/792] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:10 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:11.739498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3f7b-3ba0-430e-97ca-ec2c28f71cd9 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:11.740014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3f7b-3ba0-430e-97ca-ec2c28f71cd9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:11.740014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd3f7b-3ba0-430e-97ca-ec2c28f71cd9 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:11.742058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 401/793] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:11.748455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4911-64d0-4bad-a278-8120f348fbe7 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:11.748919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4911-64d0-4bad-a278-8120f348fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:11.748998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4911-64d0-4bad-a278-8120f348fbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:11.766971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b44a4911-64d0-4bad-a278-8120f348fbe7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:11.768170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b44a4911-64d0-4bad-a278-8120f348fbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:11.776143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 393/794] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:11 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:11.801785 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3f7b-3ba0-430e-97ca-ec2c28f71cd9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:11.814012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd3f7b-3ba0-430e-97ca-ec2c28f71cd9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:11.818994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951e2f-1c32-41cb-9f26-f007e3c2336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:11.819782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951e2f-1c32-41cb-9f26-f007e3c2336b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:11.820058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951e2f-1c32-41cb-9f26-f007e3c2336b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:11.820328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951e2f-1c32-41cb-9f26-f007e3c2336b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:11.831180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951e2f-1c32-41cb-9f26-f007e3c2336b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:11.838143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-13951e2f-1c32-41cb-9f26-f007e3c2336b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:11.839662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 402/795] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:11.846670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a4911-64d0-4bad-a278-8120f348fbe7 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:11.855641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a4911-64d0-4bad-a278-8120f348fbe7 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:11.860065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:11.860741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:11.861020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:11.861294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:11.862644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:11.862950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:11.864795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:11.873477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 394/796] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:11.879668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951e2f-1c32-41cb-9f26-f007e3c2336b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:11.889856 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951e2f-1c32-41cb-9f26-f007e3c2336b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:11.894388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:11.895193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:11.895469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:11.895741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:11.906355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:11.908234 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:11.926371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:11.927869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 403/797] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:11.934036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:11.943678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228679f-48e8-4d57-85d7-51dd2d3274f3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:11.948125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:11.948770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:11.949050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:11.949320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:11.950047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:11.950349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:11.952078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:11.968401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 395/798] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:11.974775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:11.984647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc099cc0-6c73-4da5-bc87-aa90c25fc182 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:11.990100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:11.990873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:11.991155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:11.991428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:11.999136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.001156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.015577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 11 16:56:12.017052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 404/799] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:11 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:12.023433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.034264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482fead-8a96-41d8-b94b-1b83fc8e4563 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.039046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.039731 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.040014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.040287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.041146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.041454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.043414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.066260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 396/800] 10.222.0.16 () {56 vars in 1156 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:12.072454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.082839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf1a60-5a2a-4c51-8b3c-b9b7be4fb2b0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.087419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503252e7-1152-4878-b8a0-d403cd785e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.088064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503252e7-1152-4878-b8a0-d403cd785e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.088344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503252e7-1152-4878-b8a0-d403cd785e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.088615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503252e7-1152-4878-b8a0-d403cd785e76 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.097429 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503252e7-1152-4878-b8a0-d403cd785e76 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.099217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503252e7-1152-4878-b8a0-d403cd785e76 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.108320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 405/801] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:12.115766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.125364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bcda3-e281-47f4-9745-ed917a5d25ff admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.129859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a8ee8-d2e6-45a1-877a-2cd57ea6ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.130667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8ee8-d2e6-45a1-877a-2cd57ea6ef33 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.130951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8ee8-d2e6-45a1-877a-2cd57ea6ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.131225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a8ee8-d2e6-45a1-877a-2cd57ea6ef33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.141578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a8ee8-d2e6-45a1-877a-2cd57ea6ef33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.143490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a8ee8-d2e6-45a1-877a-2cd57ea6ef33 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.160822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-069a8ee8-d2e6-45a1-877a-2cd57ea6ef33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:12.162340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 397/802] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:12.169502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503252e7-1152-4878-b8a0-d403cd785e76 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.179209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503252e7-1152-4878-b8a0-d403cd785e76 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.184887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.185558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.185837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.186108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.186887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.187190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.188809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.201565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 406/803] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:12.207353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9a03-b39e-4b2a-a55a-abfafc0df993 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.207640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9a03-b39e-4b2a-a55a-abfafc0df993 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.207917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9a03-b39e-4b2a-a55a-abfafc0df993 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.209873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 398/804] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:12.212366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.219242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d982d0f-b51e-48f3-be15-43dcbbdf5dc9 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.219819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d982d0f-b51e-48f3-be15-43dcbbdf5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.220297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d982d0f-b51e-48f3-be15-43dcbbdf5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.222614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3dcc6-540b-4f9a-81fb-828034e04bf0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.227184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.227965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.228291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.228564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.235766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.238243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.241439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7d982d0f-b51e-48f3-be15-43dcbbdf5dc9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:12.242927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7d982d0f-b51e-48f3-be15-43dcbbdf5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:12.258609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:12.258609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 407/805] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:12.259218 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 399/806] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:12 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:12.260927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.270901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efb862-df2f-4953-b6b4-595c832d5404 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.275393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.276031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.276306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.276574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.277358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.277658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.279506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d982d0f-b51e-48f3-be15-43dcbbdf5dc9 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.283873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.289638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d982d0f-b51e-48f3-be15-43dcbbdf5dc9 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.295076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.296037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.296414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.296690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.297337 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.299066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.299868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 408/807] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:12.306109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.316842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547881-f76d-469f-bdd5-6ab38ef60519 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.317768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 11 16:56:12.319344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 400/808] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:12.327171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.331917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.332885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.333338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.333756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.334796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=cc5d09e583e942e998f2c9808f1dc5b6) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.335312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.337371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.338158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d4be4-7cfa-441a-9e98-17d2d0f1b2ee admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.344989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5a18b-0e05-407a-8c23-fbad4f8da2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.345803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5a18b-0e05-407a-8c23-fbad4f8da2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.346208 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5a18b-0e05-407a-8c23-fbad4f8da2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.346587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5a18b-0e05-407a-8c23-fbad4f8da2d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.347451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5a18b-0e05-407a-8c23-fbad4f8da2d3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.347599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 409/809] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/role_assignments?user.id=cc5d09e583e942e998f2c9808f1dc5b6&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:12.353738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5a18b-0e05-407a-8c23-fbad4f8da2d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.355705 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5a18b-0e05-407a-8c23-fbad4f8da2d3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.366718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 401/810] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:12.369237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.380384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255f0a1-b8a3-4d5b-a1e2-24a14231c2b7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.385517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e071d88-50c4-4a18-8530-aa73472770c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.386482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071d88-50c4-4a18-8530-aa73472770c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.387002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071d88-50c4-4a18-8530-aa73472770c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.387439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071d88-50c4-4a18-8530-aa73472770c2 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.388371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071d88-50c4-4a18-8530-aa73472770c2 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.388986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071d88-50c4-4a18-8530-aa73472770c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.392289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071d88-50c4-4a18-8530-aa73472770c2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.398212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 410/811] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:12.673100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a715e8-ec86-47f3-bdcd-69f65c2da3f3 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.673492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a715e8-ec86-47f3-bdcd-69f65c2da3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.673799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a715e8-ec86-47f3-bdcd-69f65c2da3f3 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.675901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 402/812] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:12.681882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea61f43-f65b-4db1-a107-11265dd69c3d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.682173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea61f43-f65b-4db1-a107-11265dd69c3d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.682454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea61f43-f65b-4db1-a107-11265dd69c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.701322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7ea61f43-f65b-4db1-a107-11265dd69c3d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:12.702519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7ea61f43-f65b-4db1-a107-11265dd69c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:12.711106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 411/813] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:12 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:12.737112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a715e8-ec86-47f3-bdcd-69f65c2da3f3 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.750112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a715e8-ec86-47f3-bdcd-69f65c2da3f3 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.755801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146682-b826-4461-9384-ed1d3ac1a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.756811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146682-b826-4461-9384-ed1d3ac1a518 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.757260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146682-b826-4461-9384-ed1d3ac1a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.757722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146682-b826-4461-9384-ed1d3ac1a518 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.769688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57146682-b826-4461-9384-ed1d3ac1a518 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:12.777405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-57146682-b826-4461-9384-ed1d3ac1a518 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:56:12.779089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 403/814] 10.222.0.16 () {56 vars in 1141 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:12.785743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea61f43-f65b-4db1-a107-11265dd69c3d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.797073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea61f43-f65b-4db1-a107-11265dd69c3d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.802372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.803162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.803620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.803963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.804782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.805148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.806837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.816837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 412/815] 10.222.0.16 () {56 vars in 1136 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:12.822967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146682-b826-4461-9384-ed1d3ac1a518 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.833987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146682-b826-4461-9384-ed1d3ac1a518 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.838793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.839827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.840324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.840805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.852023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.854179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.872160 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:12.873941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 404/816] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:12.881147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.891715 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bf597-e969-4762-b9c0-3e090c407aa9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.897188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.898144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.898649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.899277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.900252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.900799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.902635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.915038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 413/817] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:12.921279 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.931608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44f57-950a-4b7f-8fb1-12e634c7806a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.936624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.937703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.938177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.938691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.947292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.949641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:12.964805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:56:12.966533 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 405/818] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:12.973521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:12.983538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99231a-3207-48c8-bdf0-0b8bdf1cc69d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:12.989221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:12.990094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:12.990625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:12.991089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:12.992152 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:12.992697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:12.994816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:13.012422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 414/819] 10.222.0.16 () {56 vars in 1170 bytes} [Thu Nov 11 16:56:12 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:13.019345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:13.029535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438484-79cc-4ef3-970f-9b19db49a89e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:13.034842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066787da-b962-4e0c-9f67-df4308dc53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:13.035732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066787da-b962-4e0c-9f67-df4308dc53c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.036202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066787da-b962-4e0c-9f67-df4308dc53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.036697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066787da-b962-4e0c-9f67-df4308dc53c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.045491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066787da-b962-4e0c-9f67-df4308dc53c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:13.047748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066787da-b962-4e0c-9f67-df4308dc53c6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:13.060040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 406/820] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:13 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:13.067156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:13.077948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc33b95-0290-4fa0-953c-ff0f8235c49a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:13.083638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:13.084778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.085296 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.085822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.101854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:13.103776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:13.122481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:13.123992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 415/821] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:13.130029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066787da-b962-4e0c-9f67-df4308dc53c6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:13.139362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066787da-b962-4e0c-9f67-df4308dc53c6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:13.144704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85dfc6-82b3-49e5-88ce-5b04cab47644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:13.145590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85dfc6-82b3-49e5-88ce-5b04cab47644 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.146081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85dfc6-82b3-49e5-88ce-5b04cab47644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.146586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85dfc6-82b3-49e5-88ce-5b04cab47644 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.147521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85dfc6-82b3-49e5-88ce-5b04cab47644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:13.148017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85dfc6-82b3-49e5-88ce-5b04cab47644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:13.149805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85dfc6-82b3-49e5-88ce-5b04cab47644 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:13.163902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 407/822] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:13.170884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:13.180996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0a734-4eca-465d-8fa4-e50db2f8cb93 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:13.185555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:13.186291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.186590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.186865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.194065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:13.196065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:13.210279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:13.211831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 416/823] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:13.215768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bb3da-3860-4669-9556-c40251376001 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.216305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bb3da-3860-4669-9556-c40251376001 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.216787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bb3da-3860-4669-9556-c40251376001 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.219086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 408/824] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:13.224593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:13.225490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56135-eaa4-49e0-8306-02cdd32af1ca None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.225779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56135-eaa4-49e0-8306-02cdd32af1ca None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.226145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b56135-eaa4-49e0-8306-02cdd32af1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.237078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4cb64-84f6-4f11-939c-80e4496a3e6c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:13.243022 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:13.243974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.244515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.244847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b2b56135-eaa4-49e0-8306-02cdd32af1ca None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:13.245199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.246044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b2b56135-eaa4-49e0-8306-02cdd32af1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:13.246441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:13.246967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:13.249111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:13.254121 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 409/825] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:13 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:13.262331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 417/826] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:13.269534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b56135-eaa4-49e0-8306-02cdd32af1ca None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:13.278991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:13.280574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b56135-eaa4-49e0-8306-02cdd32af1ca None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:13.285725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966b416-fcba-4175-8874-e5fbe277daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:13.286388 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966b416-fcba-4175-8874-e5fbe277daa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.286714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966b416-fcba-4175-8874-e5fbe277daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.286991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966b416-fcba-4175-8874-e5fbe277daa5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.287838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966b416-fcba-4175-8874-e5fbe277daa5 admin admin] RBAC: Adding query filter params (role.id=d9a01c5832ad4c4096bda26854053b9a, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=c231f9d11cce4493a85d6d5129afa3a6) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:13.288158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966b416-fcba-4175-8874-e5fbe277daa5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:13.290008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966b416-fcba-4175-8874-e5fbe277daa5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:13.292299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec53441-a063-468b-9cac-c95d8ba6b59b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:13.302579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 410/827] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:13 2021] GET /identity/v3/role_assignments?user.id=c231f9d11cce4493a85d6d5129afa3a6&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9a01c5832ad4c4096bda26854053b9a => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:13.304601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac63754-d49d-41f0-9a19-052e0b8e362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:13.305559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac63754-d49d-41f0-9a19-052e0b8e362e admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:13.305892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac63754-d49d-41f0-9a19-052e0b8e362e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:13.306246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac63754-d49d-41f0-9a19-052e0b8e362e admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:13.307247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac63754-d49d-41f0-9a19-052e0b8e362e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:13.309034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac63754-d49d-41f0-9a19-052e0b8e362e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:13.398151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 418/828] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:13 2021] POST /identity/v3/services => generated 269 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:56:14.776416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3179c-a81a-461c-938c-e817a11de6e7 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:14.776974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3179c-a81a-461c-938c-e817a11de6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:14.776974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3179c-a81a-461c-938c-e817a11de6e7 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:14.779005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 411/829] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:14.786576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c8f7-a39b-4ef1-b148-e09d03a237f8 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:14.786576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c8f7-a39b-4ef1-b148-e09d03a237f8 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:14.786576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c8f7-a39b-4ef1-b148-e09d03a237f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:14.787149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300d73-f7cd-44d0-b181-2479e5f19d84 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:14.787149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300d73-f7cd-44d0-b181-2479e5f19d84 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:14.787149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300d73-f7cd-44d0-b181-2479e5f19d84 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:14.788750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 412/830] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:14.793936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5348173-a509-4af4-a867-471bd2614fac None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:14.794247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5348173-a509-4af4-a867-471bd2614fac None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:14.794528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5348173-a509-4af4-a867-471bd2614fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:14.805387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-88c1c8f7-a39b-4ef1-b148-e09d03a237f8 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:14.806948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-88c1c8f7-a39b-4ef1-b148-e09d03a237f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:14.812639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a5348173-a509-4af4-a867-471bd2614fac None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:14.813982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a5348173-a509-4af4-a867-471bd2614fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:14.823923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 419/831] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:14 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:14.838637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 413/832] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:14 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:14.847943 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1c8f7-a39b-4ef1-b148-e09d03a237f8 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:14.858418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1c8f7-a39b-4ef1-b148-e09d03a237f8 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:14.858691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5348173-a509-4af4-a867-471bd2614fac None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:14.864450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aca8f6-79f3-47fe-8562-30ead2191416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:14.865352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca8f6-79f3-47fe-8562-30ead2191416 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:14.865805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca8f6-79f3-47fe-8562-30ead2191416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:14.866288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca8f6-79f3-47fe-8562-30ead2191416 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:14.867233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aca8f6-79f3-47fe-8562-30ead2191416 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:14.868718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5348173-a509-4af4-a867-471bd2614fac None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:14.869385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aca8f6-79f3-47fe-8562-30ead2191416 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:14.873328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:14.874235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:14.874521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:14.874837 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:14.875503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:14.877161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:14.889403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:56:14.893843 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 414/833] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:14 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:14.899474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:14.909696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802796-c6fa-4f54-bc24-d7acd7dc48cb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:14.914106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:14.914757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:14.915035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:14.915307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:14.916007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:14.916320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:14.917887 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:14.922773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 415/834] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:14 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:14.929522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:14.938980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94031-f143-4471-a7f0-9f47fd54c9d4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:14.943617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627c30a-8798-472f-be21-178c0985f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:14.944258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c30a-8798-472f-be21-178c0985f63a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:14.944535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c30a-8798-472f-be21-178c0985f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:14.944804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627c30a-8798-472f-be21-178c0985f63a admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:14.945507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c30a-8798-472f-be21-178c0985f63a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:14.945811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c30a-8798-472f-be21-178c0985f63a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:14.947485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627c30a-8798-472f-be21-178c0985f63a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:14.947697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 420/835] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:14 2021] POST /identity/v3/services => generated 251 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:14.958724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 416/836] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:14 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:15.667803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e74de5-993a-4d45-a05b-cb9d4f3c79f9 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.668210 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e74de5-993a-4d45-a05b-cb9d4f3c79f9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.668412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e74de5-993a-4d45-a05b-cb9d4f3c79f9 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.670445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 421/837] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:15.676328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654767b-938e-43fd-9e86-7567b64f4ce4 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.676617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654767b-938e-43fd-9e86-7567b64f4ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.676898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654767b-938e-43fd-9e86-7567b64f4ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.696449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-0654767b-938e-43fd-9e86-7567b64f4ce4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:15.697640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0654767b-938e-43fd-9e86-7567b64f4ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:15.715644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 417/838] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:15 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:15.740023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e74de5-993a-4d45-a05b-cb9d4f3c79f9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.753121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e74de5-993a-4d45-a05b-cb9d4f3c79f9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:15.757593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a43a78-90b0-410e-af0c-8f46523518d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:15.758391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43a78-90b0-410e-af0c-8f46523518d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.758703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43a78-90b0-410e-af0c-8f46523518d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.758977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a43a78-90b0-410e-af0c-8f46523518d3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.770239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a43a78-90b0-410e-af0c-8f46523518d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:15.777793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-61a43a78-90b0-410e-af0c-8f46523518d3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:56:15.779298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 422/839] 10.222.0.16 () {56 vars in 1141 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:15.785801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654767b-938e-43fd-9e86-7567b64f4ce4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.794870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654767b-938e-43fd-9e86-7567b64f4ce4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:15.799451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:15.800426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.800708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.800987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.801752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:15.802056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:15.802668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27f8a-6098-4678-acb1-b4dc175b5e29 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.803466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27f8a-6098-4678-acb1-b4dc175b5e29 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.803670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:15.804142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d27f8a-6098-4678-acb1-b4dc175b5e29 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.806100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 423/840] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:56:15.812111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02a49-704e-405b-ac4d-17ef2396d16a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.812634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02a49-704e-405b-ac4d-17ef2396d16a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.812952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 418/841] 10.222.0.16 () {56 vars in 1136 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:15.813325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02a49-704e-405b-ac4d-17ef2396d16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.821388 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.832187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1c93-730f-4105-80f5-55bb92b3177d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:15.837021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:15.837566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-5dc02a49-704e-405b-ac4d-17ef2396d16a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:15.838331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.838803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5dc02a49-704e-405b-ac4d-17ef2396d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:15.839072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.839536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.853533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 424/842] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:15 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:15.853712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:15.853712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:15.872278 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:15.873505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02a49-704e-405b-ac4d-17ef2396d16a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.873861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 419/843] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:15.881110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.888945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02a49-704e-405b-ac4d-17ef2396d16a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:15.893914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a58edf-4042-4adc-aab4-3e0e32a505a6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:15.895053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:15.895961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.896338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.896750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.897538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:15.898591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:15.899246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.899525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.899642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:15.899797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.900827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:15.901134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:15.903465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:15.914416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 11 16:56:15.915829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 420/844] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:15.916087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 425/845] 10.222.0.16 () {56 vars in 1153 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:15.922038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.924627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.933030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab4ec5-0ae2-42da-bf1a-8f493b48c486 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:15.934929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e24572-afb8-4abe-884c-921a438995cb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:15.938165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:15.939131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.939367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.939643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.941469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:15.942319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.942830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.943295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.944204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:15.944718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:15.946485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:15.952703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:15.952703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:15.962876 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 426/846] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:15.964220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.973854 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:56:15.974910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e9434-abe8-45bf-b588-a3cb36a8ce98 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:15.976006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 421/847] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:15.982254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:15.984432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:15.985340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:15.985839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:15.986309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:15.987803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:15.988342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:15.990437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:15.992934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214cb62-9391-4bb8-b253-ba2066b60767 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:16.001799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 427/848] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:16.003279 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:16.003565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:16.004570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:16.005042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:16.005503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:16.006734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:16.007244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:16.010066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:16.013317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13414f4e-c691-4d18-b9c2-bed22f5da1f0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:16.018136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:16.018809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:16.019143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:16.019463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:16.020346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] RBAC: Adding query filter params (interface=public, service_id=3e1911bb32d343e0a100fb50e3fc6820, region_id=RegionOne) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:16.020705 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:16.022505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:16.032581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 428/849] 10.222.0.16 () {56 vars in 1272 bytes} [Thu Nov 11 16:56:16 2021] GET /identity/v3/endpoints?service_id=3e1911bb32d343e0a100fb50e3fc6820&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:16.034159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 422/850] 10.222.0.16 () {56 vars in 1170 bytes} [Thu Nov 11 16:56:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:16.034917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:16.043743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:16.048251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0a498-ab72-4f8b-9d0f-e82b1bda5fcc admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:16.053455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dd06-d939-4968-9013-198187fe638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:16.054112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dd06-d939-4968-9013-198187fe638d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:16.054442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dd06-d939-4968-9013-198187fe638d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:16.054764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dd06-d939-4968-9013-198187fe638d admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:16.055504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165dd06-d939-4968-9013-198187fe638d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:16.056754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95eca-3027-47d6-a7db-1bda75e6f9ef admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:16.057174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165dd06-d939-4968-9013-198187fe638d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:16.062353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:16.063484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:16.069106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 429/851] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:56:16 2021] GET /identity/v3/services => generated 1268 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:56:16.069264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:16.069264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:16.080825 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:16.083039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:16.102701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:16.104321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 423/852] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:16.115779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dd06-d939-4968-9013-198187fe638d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:16.126063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dd06-d939-4968-9013-198187fe638d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:16.131620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:16.132421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:16.132705 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:16.132976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:16.133720 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:16.134019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:16.135763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:16.150039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 430/853] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:16.156646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:16.168318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57e0e4-d50e-4065-af4c-1d2042cb17c9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:16.174635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:16.175941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:16.176430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:16.176993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:16.185189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:16.187660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:16.203157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:16.205117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 424/854] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:16.213051 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:16.224122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd670c-e325-40a8-8389-eeca82721ab5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:16.229631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee1957-e3a5-413d-9d52-ac4aa65c3c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:16.230826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1957-e3a5-413d-9d52-ac4aa65c3c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:16.231323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1957-e3a5-413d-9d52-ac4aa65c3c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:16.231792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1957-e3a5-413d-9d52-ac4aa65c3c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:16.232865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee1957-e3a5-413d-9d52-ac4aa65c3c56 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:16.233369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee1957-e3a5-413d-9d52-ac4aa65c3c56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:16.235674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee1957-e3a5-413d-9d52-ac4aa65c3c56 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:16.251437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 431/855] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:16.259347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:16.271056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a59d4-bdc4-4c12-9050-dd33e80970da admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:16.276161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a7df0-2f01-430e-86f3-e3a1e715644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:16.277438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7df0-2f01-430e-86f3-e3a1e715644c admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:16.277918 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7df0-2f01-430e-86f3-e3a1e715644c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:16.278414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7df0-2f01-430e-86f3-e3a1e715644c admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/c231f9d11cce4493a85d6d5129afa3a6/roles/d9a01c5832ad4c4096bda26854053b9a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:16.281024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a7df0-2f01-430e-86f3-e3a1e715644c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=c231f9d11cce4493a85d6d5129afa3a6, role_id=d9a01c5832ad4c4096bda26854053b9a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:16.284044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a7df0-2f01-430e-86f3-e3a1e715644c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:16.362753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 425/856] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:56:16 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/c231f9d11cce4493a85d6d5129afa3a6/roles/d9a01c5832ad4c4096bda26854053b9a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:56:17.304574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59e46f-c929-47fa-87f8-750ecf3708d6 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.306074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59e46f-c929-47fa-87f8-750ecf3708d6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.306074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59e46f-c929-47fa-87f8-750ecf3708d6 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.307175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 432/857] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:17.313502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9a632-0350-4c16-8351-3c0b79540bf6 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.315319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9a632-0350-4c16-8351-3c0b79540bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.315319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9a632-0350-4c16-8351-3c0b79540bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.333340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c8e9a632-0350-4c16-8351-3c0b79540bf6 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:17.334822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c8e9a632-0350-4c16-8351-3c0b79540bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:17.397187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 426/858] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:17 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:17.399212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526af9d2-3227-4239-80b7-b07a414f3796 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.399788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526af9d2-3227-4239-80b7-b07a414f3796 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.400232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526af9d2-3227-4239-80b7-b07a414f3796 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.402111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 433/859] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:56:17.410760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9419e9-111a-4cc7-ad23-792654467617 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.410760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9419e9-111a-4cc7-ad23-792654467617 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.410760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9419e9-111a-4cc7-ad23-792654467617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.420874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526af9d2-3227-4239-80b7-b07a414f3796 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:17.427382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3d9419e9-111a-4cc7-ad23-792654467617 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:17.428720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3d9419e9-111a-4cc7-ad23-792654467617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:17.433161 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526af9d2-3227-4239-80b7-b07a414f3796 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:17.437692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:17.437898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 427/860] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:17 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:17.442466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.442466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.442466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.442466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:17.442466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:17.453980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 11 16:56:17.456169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 434/861] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:17 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:17.463935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9419e9-111a-4cc7-ad23-792654467617 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:17.464096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:17.474647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9ef85-51c4-43fe-baf4-2efde4a04810 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:17.474799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9419e9-111a-4cc7-ad23-792654467617 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:17.479318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:17.479832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732479b-a40f-48b3-a58f-cca11b533066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:17.480111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.480417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.480687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.481356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732479b-a40f-48b3-a58f-cca11b533066 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.481463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:17.481690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:17.482134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732479b-a40f-48b3-a58f-cca11b533066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.482629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732479b-a40f-48b3-a58f-cca11b533066 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.483299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:17.483774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732479b-a40f-48b3-a58f-cca11b533066 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:17.484999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-a732479b-a40f-48b3-a58f-cca11b533066 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:17.484999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:56:17.484999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:56:17.486210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732479b-a40f-48b3-a58f-cca11b533066 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:17.490165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 435/862] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:17 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:17.496783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:17.507337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155392f4-92b7-4616-8b4e-c9a8b93d9f78 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:17.511825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:17.512557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.512834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.513104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.513805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:17.514128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:17.515722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:17.520944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 436/863] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:17 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:17.527030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:17.536837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550cd4-e6c7-41d5-ac05-7bddc1d65baf admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:17.541368 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:17.542034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.542311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.542607 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.543396 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] RBAC: Adding query filter params (interface=public, service_id=908dfc09ce0d4eb99503afdf2cde4b72, region_id=RegionOne) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:17.543697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:17.545390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:17.551485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 437/864] 10.222.0.16 () {56 vars in 1272 bytes} [Thu Nov 11 16:56:17 2021] GET /identity/v3/endpoints?service_id=908dfc09ce0d4eb99503afdf2cde4b72&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:17.557421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:17.561318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 428/865] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:17 2021] POST /identity/v3/services => generated 241 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:17.573591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f7224-d318-4a1e-9113-448eb7e1af4a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:17.589823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f388a-54dc-4222-801f-1366fe096fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:17.590536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f388a-54dc-4222-801f-1366fe096fee admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:17.590892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f388a-54dc-4222-801f-1366fe096fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:17.591172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f388a-54dc-4222-801f-1366fe096fee admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:17.591867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f388a-54dc-4222-801f-1366fe096fee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:17.593790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f388a-54dc-4222-801f-1366fe096fee admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:17.601295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 438/866] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:56:17 2021] GET /identity/v3/services => generated 1497 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:56:18.444412 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171d459-a531-4820-b259-12a49160ea60 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.444901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171d459-a531-4820-b259-12a49160ea60 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.444901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171d459-a531-4820-b259-12a49160ea60 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.446912 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 429/867] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:18.452989 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864c90-a3f5-41f8-b078-ee026bdfb409 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.453424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864c90-a3f5-41f8-b078-ee026bdfb409 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.453597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864c90-a3f5-41f8-b078-ee026bdfb409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.471355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0e864c90-a3f5-41f8-b078-ee026bdfb409 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:18.472533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0e864c90-a3f5-41f8-b078-ee026bdfb409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:18.480438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 439/868] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:18 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:18.505309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171d459-a531-4820-b259-12a49160ea60 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:18.517449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171d459-a531-4820-b259-12a49160ea60 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:18.521796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:18.522604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.522882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.523151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.523801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:18.525372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:18.536748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 11 16:56:18.538217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 430/869] 10.222.0.16 () {56 vars in 1153 bytes} [Thu Nov 11 16:56:18 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:18.546200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864c90-a3f5-41f8-b078-ee026bdfb409 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:18.556002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864c90-a3f5-41f8-b078-ee026bdfb409 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:18.560481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:18.561149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.561425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.561693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.562397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:18.562722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:18.564297 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:18.570047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 440/870] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:18 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:18.576301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:18.585871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecba97-e7a0-4e34-8f7d-c1648904ef50 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:18.590332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e45e33-8975-48d7-aa6f-deb05c019f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:18.591001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e45e33-8975-48d7-aa6f-deb05c019f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.591273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e45e33-8975-48d7-aa6f-deb05c019f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.591528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e45e33-8975-48d7-aa6f-deb05c019f8b admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.592227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e45e33-8975-48d7-aa6f-deb05c019f8b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:18.592525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e45e33-8975-48d7-aa6f-deb05c019f8b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:18.594086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e45e33-8975-48d7-aa6f-deb05c019f8b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:18.599760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 431/871] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:18 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:18.605942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:18.616576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d0834-e4ec-49e0-bffd-a2192eb523b6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:18.621145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b22b-6fff-453d-aece-eeac0a795b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:18.621789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b22b-6fff-453d-aece-eeac0a795b8b admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.622062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b22b-6fff-453d-aece-eeac0a795b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.622327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b22b-6fff-453d-aece-eeac0a795b8b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.623127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b22b-6fff-453d-aece-eeac0a795b8b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:18.624703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b22b-6fff-453d-aece-eeac0a795b8b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:18.716704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 441/872] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:56:18 2021] POST /identity/v3/endpoints => generated 347 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:18.821396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7c5f3-071b-4bbe-af9f-1cc63b07d4b3 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.821758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7c5f3-071b-4bbe-af9f-1cc63b07d4b3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.821956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7c5f3-071b-4bbe-af9f-1cc63b07d4b3 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.824110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 432/873] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:18.835020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230e86a-2fb7-432b-aa5c-4d62c569a6c3 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.835535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230e86a-2fb7-432b-aa5c-4d62c569a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.835979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230e86a-2fb7-432b-aa5c-4d62c569a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.856708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a230e86a-2fb7-432b-aa5c-4d62c569a6c3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:18.858382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a230e86a-2fb7-432b-aa5c-4d62c569a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:18.877884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 442/874] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:18 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:18.905337 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7c5f3-071b-4bbe-af9f-1cc63b07d4b3 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:18.918718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7c5f3-071b-4bbe-af9f-1cc63b07d4b3 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:18.923440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e42f-e11c-4ab5-81a9-1470d32729e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:18.924514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e42f-e11c-4ab5-81a9-1470d32729e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.924942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e42f-e11c-4ab5-81a9-1470d32729e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.925358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96e42f-e11c-4ab5-81a9-1470d32729e3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.938612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96e42f-e11c-4ab5-81a9-1470d32729e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:18.947312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-5e96e42f-e11c-4ab5-81a9-1470d32729e3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:56:18.949075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 433/875] 10.222.0.16 () {56 vars in 1141 bytes} [Thu Nov 11 16:56:18 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:18.956630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230e86a-2fb7-432b-aa5c-4d62c569a6c3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:18.966048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230e86a-2fb7-432b-aa5c-4d62c569a6c3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:18.971224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:18.971933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:18.972303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:18.972684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:18.973587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:18.973981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:18.975774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:18.984941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 443/876] 10.222.0.16 () {56 vars in 1136 bytes} [Thu Nov 11 16:56:18 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:18.994391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e42f-e11c-4ab5-81a9-1470d32729e3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.004874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96e42f-e11c-4ab5-81a9-1470d32729e3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.009784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.010761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.011122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.011461 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.023037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.025022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.042166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:19.043715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 434/877] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:19.050632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.061116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec78df-3513-4a19-b4cc-5ce808c90ded admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.066663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.067615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.068125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.068697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.069666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:19.070177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.072049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.084984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 444/878] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:19.091437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.101871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03019da-2c32-4b89-9dff-a3182ebbcc04 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.108796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.109879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.110389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.110855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.120539 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.122923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.137913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 11 16:56:19.139710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 435/879] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:19.146498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.156875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d872bd9-cf2f-4077-8f50-cc29aed70f25 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.164018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.164018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.164018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.164018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.164375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:19.164530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.166460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.185812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 445/880] 10.222.0.16 () {56 vars in 1170 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:19.192744 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.202487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fcc22-1890-4e07-aa28-cf8489ea0757 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.207648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027a923-aa8d-4b09-9f0e-05b9f1b69c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.208283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a923-aa8d-4b09-9f0e-05b9f1b69c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.208562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a923-aa8d-4b09-9f0e-05b9f1b69c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.208892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027a923-aa8d-4b09-9f0e-05b9f1b69c65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.217059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027a923-aa8d-4b09-9f0e-05b9f1b69c65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.219210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027a923-aa8d-4b09-9f0e-05b9f1b69c65 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.229477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 436/881] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:19.235730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.245975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f71be-450d-4ee2-ade6-742c35d4173b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.250769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.251608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.251895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.252300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.263100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.264914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.282089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:19.290591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027a923-aa8d-4b09-9f0e-05b9f1b69c65 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.294752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 446/882] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:19.299612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027a923-aa8d-4b09-9f0e-05b9f1b69c65 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.304294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.304935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.305214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.305490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.306213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:19.306516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.308182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.321987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 437/883] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:19.328483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.338758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377f003-e30d-4016-9ca9-778cde0a0d09 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.344021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.344797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.345074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.345347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.353112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.355100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.368653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:19.370119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 447/884] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:19.376546 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.387180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b07de4-533c-4f49-822e-b075d752763b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.391886 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149a38-d1ad-4b43-9a4e-550d2126404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.392582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149a38-d1ad-4b43-9a4e-550d2126404f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.393443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149a38-d1ad-4b43-9a4e-550d2126404f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.393718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149a38-d1ad-4b43-9a4e-550d2126404f admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.394622 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52149a38-d1ad-4b43-9a4e-550d2126404f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:19.394939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52149a38-d1ad-4b43-9a4e-550d2126404f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.396838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52149a38-d1ad-4b43-9a4e-550d2126404f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.409943 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 438/885] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:19.416499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:19.427769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137d1e-8495-4f8a-9900-742a9e99214f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:19.432559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092de316-2d26-468f-af75-5e3aa9b8d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:19.433261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092de316-2d26-468f-af75-5e3aa9b8d521 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.433540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092de316-2d26-468f-af75-5e3aa9b8d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.433815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092de316-2d26-468f-af75-5e3aa9b8d521 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.434737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092de316-2d26-468f-af75-5e3aa9b8d521 admin admin] RBAC: Adding query filter params (role.id=d9a01c5832ad4c4096bda26854053b9a, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=c231f9d11cce4493a85d6d5129afa3a6) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:19.435046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092de316-2d26-468f-af75-5e3aa9b8d521 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:19.437055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092de316-2d26-468f-af75-5e3aa9b8d521 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:19.443726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 448/886] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:19 2021] GET /identity/v3/role_assignments?user.id=c231f9d11cce4493a85d6d5129afa3a6&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9a01c5832ad4c4096bda26854053b9a => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:19.990372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dad82-4632-4550-91b1-602f5bd69c8e None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:19.991085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dad82-4632-4550-91b1-602f5bd69c8e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:19.991085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dad82-4632-4550-91b1-602f5bd69c8e None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:19.992941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 439/887] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:20.000666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18ce5-32aa-4d43-8518-c23226897f1c None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.000947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18ce5-32aa-4d43-8518-c23226897f1c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.001226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18ce5-32aa-4d43-8518-c23226897f1c None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.001671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2398c8-144f-4d11-adbd-e6f0dfebc508 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.002517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2398c8-144f-4d11-adbd-e6f0dfebc508 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.003026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2398c8-144f-4d11-adbd-e6f0dfebc508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.003296 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 440/888] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:20.009432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138399a-08e0-471f-b0fb-ffc5effa16df None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.009717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138399a-08e0-471f-b0fb-ffc5effa16df None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.009999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138399a-08e0-471f-b0fb-ffc5effa16df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.027749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-fe2398c8-144f-4d11-adbd-e6f0dfebc508 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:20.029630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-fe2398c8-144f-4d11-adbd-e6f0dfebc508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:20.030320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-2138399a-08e0-471f-b0fb-ffc5effa16df None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:20.031536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2138399a-08e0-471f-b0fb-ffc5effa16df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:20.040115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 449/889] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:19 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:20.040432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 441/890] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:20 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:20.063246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2398c8-144f-4d11-adbd-e6f0dfebc508 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.065003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138399a-08e0-471f-b0fb-ffc5effa16df None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.072471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2398c8-144f-4d11-adbd-e6f0dfebc508 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.076383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138399a-08e0-471f-b0fb-ffc5effa16df None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.077160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.078026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.078391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.078739 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.079472 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.081676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.082932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.084164 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.084971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.085427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.086531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.088312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.094026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:56:20.098601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 450/891] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:20 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:20.101003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 11 16:56:20.106584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.106805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 442/892] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:20 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:20.111072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.122150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127465c-07fb-4e87-bf0f-661e9e2b9cb7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.124363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8579934-e849-4fc3-b7fd-478d6b5a1e59 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.127750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.128503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.128842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.129121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.129931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:20.130237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.131344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.131944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.132459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.132987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.133483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.134450 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:20.134998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.136854 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.137696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 451/893] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:20 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:20.144448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.145859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 443/894] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:20 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:20.152605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.161736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c83183-9fd7-4eb2-9d36-20a5d11bf734 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.166409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65a36-b45c-4ca9-ab0e-9ba25018d253 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.171529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.172191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.172468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.172740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.173487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:20.173755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.175532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.177190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.178493 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.179297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.179775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.180703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:20.186441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 452/895] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:20 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:20.186836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.186836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.188472 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.197554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 444/896] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Nov 11 16:56:20 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:20.203271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb1647-4363-41b2-8f96-89b45ebf5aba admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.204655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.209759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.210910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.212000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.212481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.213758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] RBAC: Adding query filter params (interface=public, service_id=c7507542149141f38cf5eda21eb5eade, region_id=RegionOne) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:20.214281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.215070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534e86-5c85-4647-855b-b9f8767eba44 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.216667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.220209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7398d-16ee-4dd4-a5e9-fba5c231b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.220604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7398d-16ee-4dd4-a5e9-fba5c231b63d admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.220911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7398d-16ee-4dd4-a5e9-fba5c231b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.221237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7398d-16ee-4dd4-a5e9-fba5c231b63d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.222018 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7398d-16ee-4dd4-a5e9-fba5c231b63d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.223125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-f0e7398d-16ee-4dd4-a5e9-fba5c231b63d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:20.223125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:56:20.223125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:56:20.224055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7398d-16ee-4dd4-a5e9-fba5c231b63d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.230159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 453/897] 10.222.0.16 () {56 vars in 1272 bytes} [Thu Nov 11 16:56:20 2021] GET /identity/v3/endpoints?service_id=c7507542149141f38cf5eda21eb5eade&interface=public®ion_id=RegionOne => generated 194 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:20.231584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:20.243430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6be9-0a16-4bb2-aa8b-ca465defe67a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:20.247852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eca279-fb6d-4ae2-880a-a5b930809958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:20.248494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eca279-fb6d-4ae2-880a-a5b930809958 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:20.248947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eca279-fb6d-4ae2-880a-a5b930809958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:20.249041 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eca279-fb6d-4ae2-880a-a5b930809958 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:20.249751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eca279-fb6d-4ae2-880a-a5b930809958 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:20.251422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eca279-fb6d-4ae2-880a-a5b930809958 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:20.258090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 454/898] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:56:20 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:56:20.311187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 445/899] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:56:20 2021] POST /identity/v3/endpoints => generated 346 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:56:21.135836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20639-5e1b-4b8e-a7a8-4dca6dca5b36 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.136355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20639-5e1b-4b8e-a7a8-4dca6dca5b36 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.136355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20639-5e1b-4b8e-a7a8-4dca6dca5b36 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.138435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 455/900] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:21.145110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b106-170a-4a56-85f3-b6355d267f3e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.145548 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b106-170a-4a56-85f3-b6355d267f3e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.145722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b106-170a-4a56-85f3-b6355d267f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.163766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9f22b106-170a-4a56-85f3-b6355d267f3e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:21.165119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9f22b106-170a-4a56-85f3-b6355d267f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:21.183153 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 446/901] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:21 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:21.207642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20639-5e1b-4b8e-a7a8-4dca6dca5b36 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:21.220212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20639-5e1b-4b8e-a7a8-4dca6dca5b36 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:21.224753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:21.225535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.225811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.226079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.226753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:21.228339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:21.240763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 11 16:56:21.242246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 456/902] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:21 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:21.250229 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22b106-170a-4a56-85f3-b6355d267f3e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:21.259884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22b106-170a-4a56-85f3-b6355d267f3e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:21.264471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a56cc-1e4b-40bd-b43f-78757cb59fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:21.265140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a56cc-1e4b-40bd-b43f-78757cb59fac admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.265420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a56cc-1e4b-40bd-b43f-78757cb59fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.265693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a56cc-1e4b-40bd-b43f-78757cb59fac admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.266405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a56cc-1e4b-40bd-b43f-78757cb59fac admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:21.266746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a56cc-1e4b-40bd-b43f-78757cb59fac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:21.268868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a56cc-1e4b-40bd-b43f-78757cb59fac admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:21.274099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 447/903] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:21 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:21.280342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:21.291423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07d133-4aaa-4dce-b847-ccc6171c8903 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:21.296012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf3109-4451-43fc-b248-c307e016bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:21.296662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf3109-4451-43fc-b248-c307e016bcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.296942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf3109-4451-43fc-b248-c307e016bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.297215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf3109-4451-43fc-b248-c307e016bcd7 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.297919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf3109-4451-43fc-b248-c307e016bcd7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:21.298222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf3109-4451-43fc-b248-c307e016bcd7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:21.299906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf3109-4451-43fc-b248-c307e016bcd7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:21.304915 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 457/904] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:21 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:21.843322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c97440-4576-4b1b-823e-f5c4664dc79c None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.843932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c97440-4576-4b1b-823e-f5c4664dc79c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.844373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c97440-4576-4b1b-823e-f5c4664dc79c None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.846665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 448/905] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:21.852916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf12d9-14f9-4250-8d3d-811193ea664c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.853209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf12d9-14f9-4250-8d3d-811193ea664c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.853486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf12d9-14f9-4250-8d3d-811193ea664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.871415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3caf12d9-14f9-4250-8d3d-811193ea664c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:21.872627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3caf12d9-14f9-4250-8d3d-811193ea664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:21.881190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 458/906] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:21 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:21.904617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c97440-4576-4b1b-823e-f5c4664dc79c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:21.917038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c97440-4576-4b1b-823e-f5c4664dc79c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:21.921524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:21.922291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.922587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.922868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.923523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:21.925183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:21.936128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 11 16:56:21.937591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 449/907] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Nov 11 16:56:21 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:21.946133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf12d9-14f9-4250-8d3d-811193ea664c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:21.956153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf12d9-14f9-4250-8d3d-811193ea664c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:21.960799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c632d-7e16-44bd-9557-0ea308e8fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:21.961510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c632d-7e16-44bd-9557-0ea308e8fecb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.961788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c632d-7e16-44bd-9557-0ea308e8fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.962108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c632d-7e16-44bd-9557-0ea308e8fecb admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.962849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c632d-7e16-44bd-9557-0ea308e8fecb admin admin] RBAC: Adding query filter params (name=image) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:21.963151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c632d-7e16-44bd-9557-0ea308e8fecb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:21.964733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c632d-7e16-44bd-9557-0ea308e8fecb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:21.970311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 459/908] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:21 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:21.976703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:21.987285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c3f0e-1b8e-41a9-9267-d254b6346225 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:21.992361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a77374-a58a-498a-8cc5-7d7d534471e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:21.993004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a77374-a58a-498a-8cc5-7d7d534471e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:21.993285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a77374-a58a-498a-8cc5-7d7d534471e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:21.993558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a77374-a58a-498a-8cc5-7d7d534471e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:21.994311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a77374-a58a-498a-8cc5-7d7d534471e2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:21.994645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a77374-a58a-498a-8cc5-7d7d534471e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:21.996323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a77374-a58a-498a-8cc5-7d7d534471e2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:22.001609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 450/909] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:21 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:22.586370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0479-52ad-4481-b31a-4aa6ba6588db None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.587115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0479-52ad-4481-b31a-4aa6ba6588db None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.587115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c0479-52ad-4481-b31a-4aa6ba6588db None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.589052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 460/910] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:22.596353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7b2f-6a72-4b8a-bd6f-cadcdb993f08 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.596951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7b2f-6a72-4b8a-bd6f-cadcdb993f08 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.597123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7b2f-6a72-4b8a-bd6f-cadcdb993f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.615652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-882e7b2f-6a72-4b8a-bd6f-cadcdb993f08 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:22.616832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-882e7b2f-6a72-4b8a-bd6f-cadcdb993f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:22.624845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 451/911] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:22 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:22.648681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c0479-52ad-4481-b31a-4aa6ba6588db None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:22.661444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c0479-52ad-4481-b31a-4aa6ba6588db None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:22.665877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:22.666735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.667014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.667286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.667944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:22.669528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:22.681676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:56:22.683170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 461/912] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:22.691280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e7b2f-6a72-4b8a-bd6f-cadcdb993f08 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:22.700527 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e7b2f-6a72-4b8a-bd6f-cadcdb993f08 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:22.705172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300ade-96ee-4e22-b227-7e7c85d8a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:22.705831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300ade-96ee-4e22-b227-7e7c85d8a9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.706109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300ade-96ee-4e22-b227-7e7c85d8a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.706382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300ade-96ee-4e22-b227-7e7c85d8a9f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.707144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300ade-96ee-4e22-b227-7e7c85d8a9f7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:22.707453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300ade-96ee-4e22-b227-7e7c85d8a9f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:22.709041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300ade-96ee-4e22-b227-7e7c85d8a9f7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:22.714201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 452/913] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:22.720639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:22.727120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98542acd-6096-4111-8cdd-a3a858609064 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.727410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98542acd-6096-4111-8cdd-a3a858609064 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.727705 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98542acd-6096-4111-8cdd-a3a858609064 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.729779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 453/914] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:56:22.731613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a745c9-2512-41ff-be9a-68a700435d18 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:22.736006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89451-8a74-475c-bbc3-1d744992b842 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.736301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89451-8a74-475c-bbc3-1d744992b842 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.737187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89451-8a74-475c-bbc3-1d744992b842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.737994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:22.739180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.739910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.740478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.741410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:22.742046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:22.744013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:22.750064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 462/915] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:22.757056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:22.759289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-75b89451-8a74-475c-bbc3-1d744992b842 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:22.760466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-75b89451-8a74-475c-bbc3-1d744992b842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:22.768784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 454/916] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:22 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:22.769231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056bd04-ac65-40a3-a41f-071655b924a5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:22.774226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c187a65-b192-4279-801c-0b6bb6680b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:22.775211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187a65-b192-4279-801c-0b6bb6680b1b admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.775765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187a65-b192-4279-801c-0b6bb6680b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.776250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187a65-b192-4279-801c-0b6bb6680b1b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.777243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c187a65-b192-4279-801c-0b6bb6680b1b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:22.779083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c187a65-b192-4279-801c-0b6bb6680b1b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:22.795324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b89451-8a74-475c-bbc3-1d744992b842 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:22.805199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b89451-8a74-475c-bbc3-1d744992b842 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:22.809893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:22.810554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.810905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.811315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.812077 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:22.814011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:22.816134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.common [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 11 16:56:22.858288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.sql.core [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 11 16:56:22.858288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 11 16:56:22.858288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [parameters: {'id': '4e34f5d75a38460db2b3f4e358cde31c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 11 16:56:22.858288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79381) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 11 16:56:22.865608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4e34f5d75a38460db2b3f4e358cde31c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4e34f5d75a38460db2b3f4e358cde31c. Nov 11 16:56:22.867354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 455/917] 10.222.0.16 () {60 vars in 1161 bytes} [Thu Nov 11 16:56:22 2021] POST /identity/v3/projects => generated 262 bytes in 72 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:22.874114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:22.876923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 463/918] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:56:22 2021] POST /identity/v3/endpoints => generated 349 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:56:22.888917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad84c41-88fb-428a-81bd-9b77d44f5d13 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:22.909394 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbbc17-88c0-427d-84eb-1c4611e0b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:22.910593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbc17-88c0-427d-84eb-1c4611e0b6da admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.911103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbc17-88c0-427d-84eb-1c4611e0b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.911720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbc17-88c0-427d-84eb-1c4611e0b6da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.920828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbbc17-88c0-427d-84eb-1c4611e0b6da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:22.924427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbbc17-88c0-427d-84eb-1c4611e0b6da admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:22.940947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-e8bbbc17-88c0-427d-84eb-1c4611e0b6da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:22.943019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 456/919] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:22.954582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c187a65-b192-4279-801c-0b6bb6680b1b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:22.960671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c187a65-b192-4279-801c-0b6bb6680b1b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:22.965389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51e2a9-76af-460a-a48c-f0f3bf2b8f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:22.966150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e2a9-76af-460a-a48c-f0f3bf2b8f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:22.966528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e2a9-76af-460a-a48c-f0f3bf2b8f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:22.966823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51e2a9-76af-460a-a48c-f0f3bf2b8f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:22.967656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51e2a9-76af-460a-a48c-f0f3bf2b8f0b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:22.967959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51e2a9-76af-460a-a48c-f0f3bf2b8f0b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:22.969901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51e2a9-76af-460a-a48c-f0f3bf2b8f0b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:22.990839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 464/920] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:22 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:23.655166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fabbc-b530-4469-aeb7-767b7c0a9513 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:23.655683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fabbc-b530-4469-aeb7-767b7c0a9513 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:23.655683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fabbc-b530-4469-aeb7-767b7c0a9513 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:23.657719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 457/921] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:23.664407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d703-db23-412e-92b8-62ca5b6766dd None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:23.664847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d703-db23-412e-92b8-62ca5b6766dd None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:23.665020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d703-db23-412e-92b8-62ca5b6766dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:23.683025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-41a1d703-db23-412e-92b8-62ca5b6766dd None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:23.684207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-41a1d703-db23-412e-92b8-62ca5b6766dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:23.693027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 465/922] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:23 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:23.716378 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fabbc-b530-4469-aeb7-767b7c0a9513 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:23.729410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fabbc-b530-4469-aeb7-767b7c0a9513 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:23.733887 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e8f41-346e-4fe5-808d-f9d8cdf5827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:23.734529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8f41-346e-4fe5-808d-f9d8cdf5827b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:23.734844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8f41-346e-4fe5-808d-f9d8cdf5827b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:23.735112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8f41-346e-4fe5-808d-f9d8cdf5827b admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:23.735843 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e8f41-346e-4fe5-808d-f9d8cdf5827b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:23.738016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e8f41-346e-4fe5-808d-f9d8cdf5827b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:23.837291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 458/923] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:23 2021] POST /identity/v3/services => generated 242 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:24.473489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea940-474a-4ab5-998b-f4cc89419206 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:24.473489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea940-474a-4ab5-998b-f4cc89419206 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:24.473489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea940-474a-4ab5-998b-f4cc89419206 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:24.474283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 466/924] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:24.480828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a03ac-8c53-4c01-a436-7360da5edee0 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:24.481376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a03ac-8c53-4c01-a436-7360da5edee0 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:24.481850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a03ac-8c53-4c01-a436-7360da5edee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:24.512216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ac1a03ac-8c53-4c01-a436-7360da5edee0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:24.513728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ac1a03ac-8c53-4c01-a436-7360da5edee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:24.540427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 459/925] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:24 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:24.591625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ea940-474a-4ab5-998b-f4cc89419206 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:24.622996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ea940-474a-4ab5-998b-f4cc89419206 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:24.627990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dc17c-161f-4a29-abd7-8d98fc644670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:24.629735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dc17c-161f-4a29-abd7-8d98fc644670 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:24.630223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dc17c-161f-4a29-abd7-8d98fc644670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:24.630865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dc17c-161f-4a29-abd7-8d98fc644670 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:24.632064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dc17c-161f-4a29-abd7-8d98fc644670 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:24.636296 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dc17c-161f-4a29-abd7-8d98fc644670 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:24.711317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 467/926] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:24 2021] POST /identity/v3/services => generated 242 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:25.394202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd765-6353-460f-96e0-7e4389ea7c7c None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.394775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd765-6353-460f-96e0-7e4389ea7c7c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.394851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dd765-6353-460f-96e0-7e4389ea7c7c None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.396910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 460/927] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:56:25.402913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de8938-3246-4b13-ba41-f11d38804497 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.403204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de8938-3246-4b13-ba41-f11d38804497 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.403482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de8938-3246-4b13-ba41-f11d38804497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.421209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e7de8938-3246-4b13-ba41-f11d38804497 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:25.422308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e7de8938-3246-4b13-ba41-f11d38804497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:25.428525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c50dd-4265-431a-91b9-7b188eb36f65 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.428885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c50dd-4265-431a-91b9-7b188eb36f65 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.429164 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c50dd-4265-431a-91b9-7b188eb36f65 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.431185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 461/928] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:25.440431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99687d-dac0-4289-87c0-6478a5c36311 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.440830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99687d-dac0-4289-87c0-6478a5c36311 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.441213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99687d-dac0-4289-87c0-6478a5c36311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.442233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 468/929] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:25 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:25.462959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-0e99687d-dac0-4289-87c0-6478a5c36311 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:25.464123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0e99687d-dac0-4289-87c0-6478a5c36311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:25.469321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de8938-3246-4b13-ba41-f11d38804497 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:25.472182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 462/930] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:25 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:25.478606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de8938-3246-4b13-ba41-f11d38804497 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:25.483126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:25.483912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.484187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.484450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.485096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:25.487011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:25.499052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:56:25.499335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99687d-dac0-4289-87c0-6478a5c36311 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:25.500480 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 469/931] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:56:25.507479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:25.509305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99687d-dac0-4289-87c0-6478a5c36311 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:25.514052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:25.514820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.515099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.515373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.516101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:25.518158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936fdb7-11b5-4026-b244-ecb497415f8f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:25.518492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:25.522941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:25.523581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.523856 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.524125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.524823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:25.525146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:25.526797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:25.532262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 470/932] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:25 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:25.538560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:25.548277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b216e0-b085-4532-8ad9-9ae0acf06445 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:25.552709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:25.553378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.553657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.553932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.554694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:25.554998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:25.556661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:25.561873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 471/933] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:25 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:25.568531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:25.577776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71df228-1293-4615-a268-c8822dd80d2d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:25.583048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:25.583668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.583946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.584217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.584987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] RBAC: Adding query filter params (interface=admin, service_id=c7507542149141f38cf5eda21eb5eade, region_id=RegionOne) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:25.585291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:25.587866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.sql.core [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 11 16:56:25.587866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 11 16:56:25.587866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [parameters: {'user_id': 'ea559d9552c9407a892f4f3bb118fd4b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 11 16:56:25.587866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79381) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 11 16:56:25.590970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:25.593912 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 11 16:56:25.597118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 472/934] 10.222.0.16 () {56 vars in 1270 bytes} [Thu Nov 11 16:56:25 2021] GET /identity/v3/endpoints?service_id=c7507542149141f38cf5eda21eb5eade&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:25.598683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 463/935] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 16:56:25 2021] POST /identity/v3/users => generated 160 bytes in 100 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:25.603549 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:25.605724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:25.614537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7674-25ad-431d-aa44-c882b413ab59 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:25.618390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddb58-67b6-421a-9a3b-a70e592a8e37 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:25.619516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:25.620324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.620623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.620898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.625172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad8f1b-6f77-4825-8aa1-e256623f44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:25.626070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8f1b-6f77-4825-8aa1-e256623f44b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.626582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8f1b-6f77-4825-8aa1-e256623f44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.627574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8f1b-6f77-4825-8aa1-e256623f44b8 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.628503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8f1b-6f77-4825-8aa1-e256623f44b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:25.629956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:25.631166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8f1b-6f77-4825-8aa1-e256623f44b8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:25.632110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:25.650589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 11 16:56:25.650589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 473/937] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:25 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:25.651155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 464/937] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:56:25 2021] GET /identity/v3/services => generated 1957 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:56:25.656056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:25.666949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d768-4d29-48da-be81-fa60997bf1fe admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:25.672013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1c1b8-b0de-48a9-93c3-4682010b3228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:25.672658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c1b8-b0de-48a9-93c3-4682010b3228 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:25.672994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c1b8-b0de-48a9-93c3-4682010b3228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:25.673269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1c1b8-b0de-48a9-93c3-4682010b3228 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:25.674162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c1b8-b0de-48a9-93c3-4682010b3228 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:25.674469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c1b8-b0de-48a9-93c3-4682010b3228 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:25.676627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1c1b8-b0de-48a9-93c3-4682010b3228 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:25.718565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 474/938] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Nov 11 16:56:25 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:26.273609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0f3d-26e2-43d8-a268-a0d982444e2a None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:26.273983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0f3d-26e2-43d8-a268-a0d982444e2a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:26.274189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0f3d-26e2-43d8-a268-a0d982444e2a None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:26.276129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 465/939] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:26.281774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035f14-0c91-48d0-9cab-cddf21145ffd None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:26.282063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035f14-0c91-48d0-9cab-cddf21145ffd None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:26.282340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93035f14-0c91-48d0-9cab-cddf21145ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:26.299823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-93035f14-0c91-48d0-9cab-cddf21145ffd None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:26.301003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-93035f14-0c91-48d0-9cab-cddf21145ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:26.308740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 475/940] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:26 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:26.334192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f0f3d-26e2-43d8-a268-a0d982444e2a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:26.346218 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f0f3d-26e2-43d8-a268-a0d982444e2a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:26.350500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:26.351305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:26.351613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:26.351882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:26.352504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:26.354072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:26.365158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 11 16:56:26.366421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 466/941] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:26 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:26.372732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93035f14-0c91-48d0-9cab-cddf21145ffd None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:26.382095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93035f14-0c91-48d0-9cab-cddf21145ffd None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:26.386575 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:26.387237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:26.387515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:26.387788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:26.388504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:26.388805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:26.390386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:26.396173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 476/942] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:26 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:26.402227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:26.411985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d703ca-4660-40ec-86aa-ef4f0546f6c0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:26.416382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:26.417025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:26.417304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:26.417576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:26.418280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:26.418610 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:26.420306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:26.425233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 467/943] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:26 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:26.431753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:26.442611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20750cc-b5d2-40f0-86ed-d0e11d6bc3ad admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:26.448025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc3828-30e1-4168-839d-db9714c69c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:26.448775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3828-30e1-4168-839d-db9714c69c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:26.449095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3828-30e1-4168-839d-db9714c69c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:26.449411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3828-30e1-4168-839d-db9714c69c26 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:26.450349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3828-30e1-4168-839d-db9714c69c26 admin admin] RBAC: Adding query filter params (interface=public, service_id=948d9920f4994435b8b20031734cf86e, region_id=RegionOne) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:26.450748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3828-30e1-4168-839d-db9714c69c26 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:26.452652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3828-30e1-4168-839d-db9714c69c26 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:26.460627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 477/944] 10.222.0.16 () {56 vars in 1272 bytes} [Thu Nov 11 16:56:26 2021] GET /identity/v3/endpoints?service_id=948d9920f4994435b8b20031734cf86e&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:26.464927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:26.474752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cdabf-a989-4468-a449-a990b3386486 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:26.479657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3509df-2770-4b93-8b38-2abd509856d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:26.480316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3509df-2770-4b93-8b38-2abd509856d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:26.480599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3509df-2770-4b93-8b38-2abd509856d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:26.480875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3509df-2770-4b93-8b38-2abd509856d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:26.481563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3509df-2770-4b93-8b38-2abd509856d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:26.483201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3509df-2770-4b93-8b38-2abd509856d5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:26.490837 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 468/945] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:56:26 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:56:27.119655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0295d99-8f73-4631-99dc-46467ea41edc None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.120291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0295d99-8f73-4631-99dc-46467ea41edc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.120291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0295d99-8f73-4631-99dc-46467ea41edc None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:27.122108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 478/946] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:27.128406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24875bca-56b2-4955-8cb9-bd68b6e94636 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.128694 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24875bca-56b2-4955-8cb9-bd68b6e94636 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.128967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24875bca-56b2-4955-8cb9-bd68b6e94636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:27.147359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-24875bca-56b2-4955-8cb9-bd68b6e94636 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:27.148972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-24875bca-56b2-4955-8cb9-bd68b6e94636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:27.160101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 469/947] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:27 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:27.189043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0295d99-8f73-4631-99dc-46467ea41edc None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:27.203355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0295d99-8f73-4631-99dc-46467ea41edc None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:27.208905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:27.209780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.210096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.210401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:27.211187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:27.213016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:27.225791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 11 16:56:27.227291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 479/948] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Nov 11 16:56:27 2021] GET /identity/v3/services/image => generated 86 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:27.234598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24875bca-56b2-4955-8cb9-bd68b6e94636 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:27.244643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24875bca-56b2-4955-8cb9-bd68b6e94636 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:27.249350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:27.250089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.250433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.250892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:27.251680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:27.252626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:27.254276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:27.259619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 470/949] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:27 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:56:27.265896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:27.275597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a01235-ef86-4f8b-9c8f-3b83fd7c7f44 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:27.280126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:27.280772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.281053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.281326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:27.282035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:27.282336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:27.283950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:27.288894 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 480/950] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:27 2021] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:27.295036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:27.305436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba371e9-6acd-4567-a694-71c8727da019 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:27.310128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374222c-7ac4-4618-af3f-0da92bf605b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:27.310799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374222c-7ac4-4618-af3f-0da92bf605b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.311080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374222c-7ac4-4618-af3f-0da92bf605b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.311354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374222c-7ac4-4618-af3f-0da92bf605b0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:27.312136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374222c-7ac4-4618-af3f-0da92bf605b0 admin admin] RBAC: Adding query filter params (interface=public, service_id=adf6b28ad0df43b7babd6a989974f4fe, region_id=RegionOne) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:27.312445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374222c-7ac4-4618-af3f-0da92bf605b0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:27.313439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-6374222c-7ac4-4618-af3f-0da92bf605b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:27.313439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:56:27.313439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:56:27.314972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374222c-7ac4-4618-af3f-0da92bf605b0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:27.322675 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 471/951] 10.222.0.16 () {56 vars in 1272 bytes} [Thu Nov 11 16:56:27 2021] GET /identity/v3/endpoints?service_id=adf6b28ad0df43b7babd6a989974f4fe&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:27.329073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:27.339436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847924-3c1a-4eab-9ec6-dccc8f338ef7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:27.344293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3218d-7038-460c-ace2-08c2c565fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:27.344940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3218d-7038-460c-ace2-08c2c565fd14 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.345215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3218d-7038-460c-ace2-08c2c565fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.345482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3218d-7038-460c-ace2-08c2c565fd14 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:27.346732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3218d-7038-460c-ace2-08c2c565fd14 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:27.348361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3218d-7038-460c-ace2-08c2c565fd14 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:27.362618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 481/952] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:56:27 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 16:56:27.980506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af303-c225-4bce-bd3f-f9ae3ae913d4 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.981056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af303-c225-4bce-bd3f-f9ae3ae913d4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.981056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af303-c225-4bce-bd3f-f9ae3ae913d4 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:27.982975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 472/953] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:27.989646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93584e-ec00-4c67-a912-5033d0325404 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:27.989930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93584e-ec00-4c67-a912-5033d0325404 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:27.990209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93584e-ec00-4c67-a912-5033d0325404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.008246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ed93584e-ec00-4c67-a912-5033d0325404 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:28.010077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ed93584e-ec00-4c67-a912-5033d0325404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:28.018623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 482/954] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:27 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:28.043738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3af303-c225-4bce-bd3f-f9ae3ae913d4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:28.056722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3af303-c225-4bce-bd3f-f9ae3ae913d4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:28.061002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:28.061786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.062118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.062390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.063141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:28.065312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:28.076540 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 11 16:56:28.078014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 473/955] 10.222.0.16 () {56 vars in 1147 bytes} [Thu Nov 11 16:56:28 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:28.084606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93584e-ec00-4c67-a912-5033d0325404 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:28.093648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93584e-ec00-4c67-a912-5033d0325404 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:28.098036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:28.098709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.098985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.099528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.100143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:28.100455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:28.102025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:28.112450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 483/956] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:28.114228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:28.125328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb2e97-bbfa-487f-b926-3c9e6859663e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:28.130416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec66ff-c578-4e09-a9a9-1010a09b3297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:28.131074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec66ff-c578-4e09-a9a9-1010a09b3297 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.131354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec66ff-c578-4e09-a9a9-1010a09b3297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.131623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec66ff-c578-4e09-a9a9-1010a09b3297 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.132322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec66ff-c578-4e09-a9a9-1010a09b3297 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:28.132619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec66ff-c578-4e09-a9a9-1010a09b3297 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:28.134182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec66ff-c578-4e09-a9a9-1010a09b3297 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:28.139271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 474/957] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Nov 11 16:56:28 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:28.145634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:28.157003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243b1e-8310-4154-9909-75fb149fd902 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:28.160445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8870d1-2529-476d-aa1d-03ea60f63587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:28.161158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8870d1-2529-476d-aa1d-03ea60f63587 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.161499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8870d1-2529-476d-aa1d-03ea60f63587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.161834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8870d1-2529-476d-aa1d-03ea60f63587 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.162684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8870d1-2529-476d-aa1d-03ea60f63587 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:28.164501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8870d1-2529-476d-aa1d-03ea60f63587 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:28.236875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 484/958] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:56:28 2021] POST /identity/v3/endpoints => generated 325 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:28.801528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d3cd-85b3-4b67-9182-8388625063ed None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.801908 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d3cd-85b3-4b67-9182-8388625063ed None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.802085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2d3cd-85b3-4b67-9182-8388625063ed None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.804023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 475/959] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:28.809873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca27b-8383-4362-85a1-26a7c8fb5f0a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.810166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca27b-8383-4362-85a1-26a7c8fb5f0a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.810444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeca27b-8383-4362-85a1-26a7c8fb5f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.828355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0aeca27b-8383-4362-85a1-26a7c8fb5f0a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:28.829528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0aeca27b-8383-4362-85a1-26a7c8fb5f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:28.845907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 485/960] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:28 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:28.871459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2d3cd-85b3-4b67-9182-8388625063ed None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:28.884746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2d3cd-85b3-4b67-9182-8388625063ed None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:28.889230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:28.890100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.890486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.890914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.891673 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:28.893374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:28.904618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 11 16:56:28.906883 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 476/961] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:28.912655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca27b-8383-4362-85a1-26a7c8fb5f0a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:28.921615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeca27b-8383-4362-85a1-26a7c8fb5f0a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:28.926634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:28.927285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.927562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.927831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.928537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:28.928836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:28.930436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:28.935420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 486/962] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:28 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:28.942323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:28.952250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc5be-55d3-47c9-8c7e-4b9bc2ea1d27 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:28.956772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f30374-50bb-4315-b037-e8acc94c10df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:28.957431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30374-50bb-4315-b037-e8acc94c10df admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.957712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30374-50bb-4315-b037-e8acc94c10df admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.957989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30374-50bb-4315-b037-e8acc94c10df admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.958805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f30374-50bb-4315-b037-e8acc94c10df admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:28.959113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f30374-50bb-4315-b037-e8acc94c10df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:28.960687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f30374-50bb-4315-b037-e8acc94c10df admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:28.966737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 477/963] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Nov 11 16:56:28 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:28.972659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:28.982455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bd628-56c3-45db-ac2e-7aec98407502 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:28.987493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b25a1-bd6d-48ca-948e-78a826319154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:28.988327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b25a1-bd6d-48ca-948e-78a826319154 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:28.988921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b25a1-bd6d-48ca-948e-78a826319154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:28.989261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b25a1-bd6d-48ca-948e-78a826319154 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:28.990073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b25a1-bd6d-48ca-948e-78a826319154 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:28.991767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b25a1-bd6d-48ca-948e-78a826319154 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:29.071019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 487/964] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:56:28 2021] POST /identity/v3/endpoints => generated 334 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:29.706359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1782ff-f079-4182-9761-288d73dd2697 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:29.706988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1782ff-f079-4182-9761-288d73dd2697 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:29.706988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1782ff-f079-4182-9761-288d73dd2697 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:29.708912 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 478/965] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:29.714701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0dbb0-42b8-480a-a152-d57704865538 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:29.715228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0dbb0-42b8-480a-a152-d57704865538 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:29.715228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0dbb0-42b8-480a-a152-d57704865538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:29.733892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-eca0dbb0-42b8-480a-a152-d57704865538 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:29.735094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-eca0dbb0-42b8-480a-a152-d57704865538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:29.752392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 488/966] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:29 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:29.776708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1782ff-f079-4182-9761-288d73dd2697 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:29.788274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1782ff-f079-4182-9761-288d73dd2697 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:29.792493 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:29.793252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:29.793526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:29.793792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:29.794434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:29.796020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:29.806983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 11 16:56:29.808275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 479/967] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Nov 11 16:56:29 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:29.815283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0dbb0-42b8-480a-a152-d57704865538 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:29.825120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0dbb0-42b8-480a-a152-d57704865538 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:29.831020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:29.831872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:29.832245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:29.832646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:29.833552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:29.833951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:29.836122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:29.841560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 489/968] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:29 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:29.848509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:29.858332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f444fe2-d82d-4c96-aaf0-ad8984093e5b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:29.863831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a1dc0-0865-4030-af79-2cd6019ff719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:29.864466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a1dc0-0865-4030-af79-2cd6019ff719 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:29.864744 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a1dc0-0865-4030-af79-2cd6019ff719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:29.865013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a1dc0-0865-4030-af79-2cd6019ff719 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:29.865715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a1dc0-0865-4030-af79-2cd6019ff719 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:29.866023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a1dc0-0865-4030-af79-2cd6019ff719 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:29.867685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a1dc0-0865-4030-af79-2cd6019ff719 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:29.874091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 480/969] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:29.879917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:29.889564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550fc37-72d9-408b-abab-266959341319 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:29.894110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f434e-67a5-41a8-9539-8ea5d56e23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:29.894778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f434e-67a5-41a8-9539-8ea5d56e23fc admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:29.895065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f434e-67a5-41a8-9539-8ea5d56e23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:29.895338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f434e-67a5-41a8-9539-8ea5d56e23fc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:29.896086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f434e-67a5-41a8-9539-8ea5d56e23fc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:29.897661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f434e-67a5-41a8-9539-8ea5d56e23fc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:29.973669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 490/970] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:56:29 2021] POST /identity/v3/endpoints => generated 327 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:30.563925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442410f-a741-4560-8e71-eb474062e218 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:30.564399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442410f-a741-4560-8e71-eb474062e218 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:30.564759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442410f-a741-4560-8e71-eb474062e218 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:30.567416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 481/971] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:30.573196 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85c179-8f14-4c8c-bb79-f7b93c7c0cde None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:30.573479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85c179-8f14-4c8c-bb79-f7b93c7c0cde None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:30.573747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85c179-8f14-4c8c-bb79-f7b93c7c0cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:30.591134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7c85c179-8f14-4c8c-bb79-f7b93c7c0cde None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:30.592295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7c85c179-8f14-4c8c-bb79-f7b93c7c0cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:30.610610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 491/972] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:30.636340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442410f-a741-4560-8e71-eb474062e218 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:30.649117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442410f-a741-4560-8e71-eb474062e218 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:30.653426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02460f6-a189-4bc9-93a5-ea30f127a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:30.654212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02460f6-a189-4bc9-93a5-ea30f127a573 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:30.654486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02460f6-a189-4bc9-93a5-ea30f127a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:30.654779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02460f6-a189-4bc9-93a5-ea30f127a573 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:30.655951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02460f6-a189-4bc9-93a5-ea30f127a573 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:30.657626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02460f6-a189-4bc9-93a5-ea30f127a573 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:30.659463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 482/973] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:30.665665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85c179-8f14-4c8c-bb79-f7b93c7c0cde None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:30.674744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85c179-8f14-4c8c-bb79-f7b93c7c0cde None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:30.679290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da9560-a29b-4122-9185-0f9ec00ab8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:30.679940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9560-a29b-4122-9185-0f9ec00ab8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:30.680221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9560-a29b-4122-9185-0f9ec00ab8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:30.680498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9560-a29b-4122-9185-0f9ec00ab8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:30.681215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da9560-a29b-4122-9185-0f9ec00ab8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:30.683123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da9560-a29b-4122-9185-0f9ec00ab8d1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:30.825641 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 492/974] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:30 2021] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:56:31.483463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5481cb-63e4-432e-87c4-0110a1094d17 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.484062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5481cb-63e4-432e-87c4-0110a1094d17 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.484062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5481cb-63e4-432e-87c4-0110a1094d17 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.485683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 483/975] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:31.492604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41d00-1595-4aa7-9da1-3e33ade99e4c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.492900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41d00-1595-4aa7-9da1-3e33ade99e4c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.493177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41d00-1595-4aa7-9da1-3e33ade99e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.510278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-f1a41d00-1595-4aa7-9da1-3e33ade99e4c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:31.511478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f1a41d00-1595-4aa7-9da1-3e33ade99e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:31.566116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 493/976] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:31.592543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5481cb-63e4-432e-87c4-0110a1094d17 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.605195 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5481cb-63e4-432e-87c4-0110a1094d17 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.609483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea29ca2-3994-4291-84dc-00d319e8cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.610286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29ca2-3994-4291-84dc-00d319e8cb62 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.610584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29ca2-3994-4291-84dc-00d319e8cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.610853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea29ca2-3994-4291-84dc-00d319e8cb62 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.621946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea29ca2-3994-4291-84dc-00d319e8cb62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:31.629403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-5ea29ca2-3994-4291-84dc-00d319e8cb62 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:56:31.630665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 484/977] 10.222.0.16 () {56 vars in 1141 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:31.637231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a41d00-1595-4aa7-9da1-3e33ade99e4c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.646257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a41d00-1595-4aa7-9da1-3e33ade99e4c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.650727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.651384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.651661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.651938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.652686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:31.652988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:31.654594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:31.663509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 494/978] 10.222.0.16 () {56 vars in 1136 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:31.670020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea29ca2-3994-4291-84dc-00d319e8cb62 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.680715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea29ca2-3994-4291-84dc-00d319e8cb62 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.685207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.685983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.686259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.686525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.697977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:31.699033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:31.716072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:31.717503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 485/979] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:31.724372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.734217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ca39-46d4-4401-b98d-3e9b6d601c60 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.740105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.740764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.741047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.741322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.742049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:31.742353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:31.744013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:31.756426 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 495/980] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:31.762703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.775055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bd02c-b25e-4cb0-83a4-1edb31328858 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.789213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.790375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.790921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.791393 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.799713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:31.802010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:31.816403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:56:31.818171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 486/981] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:31.824319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.834576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13577ed-b106-44c0-b722-d5e2468ccc97 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.839233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.839969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.840323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.840666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.841577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:31.841945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:31.843834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:31.862707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 496/982] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:31.869277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.879386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fa825-8f0d-4081-923f-4bf3ac5f8287 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.884187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ffb65-289b-4f2d-8e5e-369c2f99ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.884855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffb65-289b-4f2d-8e5e-369c2f99ce98 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.885189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffb65-289b-4f2d-8e5e-369c2f99ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.885500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffb65-289b-4f2d-8e5e-369c2f99ce98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.894428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ffb65-289b-4f2d-8e5e-369c2f99ce98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:31.896263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ffb65-289b-4f2d-8e5e-369c2f99ce98 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:31.910569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 487/983] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:56:31.913459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.923445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a43a5-65ab-417f-ac8f-aedacdc77ad4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.928141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.928990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.929273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.929603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.940717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:31.942665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:31.961236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:31.966630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 497/984] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:31.969029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ffb65-289b-4f2d-8e5e-369c2f99ce98 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:31.978800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ffb65-289b-4f2d-8e5e-369c2f99ce98 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:31.983411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:31.984290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:31.984578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:31.984925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:31.985774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:31.986173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:31.987870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:32.000143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 488/985] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:32.006200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:32.015971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283fa04-27c5-4325-8653-040673b1f847 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:32.021210 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:32.022031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:32.022316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:32.022621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:32.029678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:32.031668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:32.045878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:32.047299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 498/986] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:32.053540 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:32.063252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e3347-d5b7-46ba-87e7-58c50edb34c8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:32.067914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f91944-5fba-495e-85be-a326cb5e73e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:32.068663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f91944-5fba-495e-85be-a326cb5e73e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:32.069016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f91944-5fba-495e-85be-a326cb5e73e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:32.069361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f91944-5fba-495e-85be-a326cb5e73e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:32.070229 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f91944-5fba-495e-85be-a326cb5e73e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:32.070643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f91944-5fba-495e-85be-a326cb5e73e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:32.072552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f91944-5fba-495e-85be-a326cb5e73e3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:32.087912 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 489/987] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:32.093710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:32.104809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114d32-2482-45a0-891a-2c22f21af054 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:32.112526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22f85-92b5-459e-94b8-a4185099ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:32.113293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22f85-92b5-459e-94b8-a4185099ed05 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:32.113827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22f85-92b5-459e-94b8-a4185099ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:32.114127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22f85-92b5-459e-94b8-a4185099ed05 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:32.115010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d22f85-92b5-459e-94b8-a4185099ed05 admin admin] RBAC: Adding query filter params (role.id=d9a01c5832ad4c4096bda26854053b9a, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=0941777cfcbf4532be31ca001ced8aa7) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:32.115324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d22f85-92b5-459e-94b8-a4185099ed05 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:32.117189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d22f85-92b5-459e-94b8-a4185099ed05 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:32.123665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 499/988] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:32 2021] GET /identity/v3/role_assignments?user.id=0941777cfcbf4532be31ca001ced8aa7&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9a01c5832ad4c4096bda26854053b9a => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:32.365432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482d2dc-3fbb-4f90-bc69-8bd17b95dd74 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:32.365860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482d2dc-3fbb-4f90-bc69-8bd17b95dd74 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:32.365979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482d2dc-3fbb-4f90-bc69-8bd17b95dd74 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:32.367793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 490/989] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:32.374155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc08e-bd9e-4083-8c9f-0236046f85b4 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:32.374459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc08e-bd9e-4083-8c9f-0236046f85b4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:32.374768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc08e-bd9e-4083-8c9f-0236046f85b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:32.393142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-693bc08e-bd9e-4083-8c9f-0236046f85b4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:32.394316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-693bc08e-bd9e-4083-8c9f-0236046f85b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:32.402608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 500/990] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:32.424991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482d2dc-3fbb-4f90-bc69-8bd17b95dd74 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:32.436704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482d2dc-3fbb-4f90-bc69-8bd17b95dd74 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:32.441472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861ed88-adbc-46e8-bc61-cc8949761293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:32.442096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861ed88-adbc-46e8-bc61-cc8949761293 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:32.442372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861ed88-adbc-46e8-bc61-cc8949761293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:32.442670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861ed88-adbc-46e8-bc61-cc8949761293 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:32.455756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861ed88-adbc-46e8-bc61-cc8949761293 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:32.459178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861ed88-adbc-46e8-bc61-cc8949761293 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:32.469498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 491/991] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:32.480867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bc08e-bd9e-4083-8c9f-0236046f85b4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:32.493905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bc08e-bd9e-4083-8c9f-0236046f85b4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:32.500075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063e154-0a64-483a-987d-0d6934d84646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:32.501253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063e154-0a64-483a-987d-0d6934d84646 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:32.502352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063e154-0a64-483a-987d-0d6934d84646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:32.502806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063e154-0a64-483a-987d-0d6934d84646 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:32.504210 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063e154-0a64-483a-987d-0d6934d84646 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:32.505881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063e154-0a64-483a-987d-0d6934d84646 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:32.507507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 501/992] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:33.185017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501522fd-9dcd-41b0-8b8a-f2ce431465b3 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:33.185524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501522fd-9dcd-41b0-8b8a-f2ce431465b3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:33.185524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501522fd-9dcd-41b0-8b8a-f2ce431465b3 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:33.187332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 492/993] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:33.193866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4288-3685-400b-a014-8d45b950dfbe None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:33.194284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4288-3685-400b-a014-8d45b950dfbe None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:33.194411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4288-3685-400b-a014-8d45b950dfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:33.212283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-f6bf4288-3685-400b-a014-8d45b950dfbe None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:33.213446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f6bf4288-3685-400b-a014-8d45b950dfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:33.221270 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 502/994] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:33.248894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501522fd-9dcd-41b0-8b8a-f2ce431465b3 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:33.261603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501522fd-9dcd-41b0-8b8a-f2ce431465b3 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:33.265879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72b0d0-d59f-4a5d-aa21-374976075b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:33.266689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72b0d0-d59f-4a5d-aa21-374976075b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:33.266968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72b0d0-d59f-4a5d-aa21-374976075b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:33.267311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72b0d0-d59f-4a5d-aa21-374976075b98 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:33.268415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72b0d0-d59f-4a5d-aa21-374976075b98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:33.270090 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72b0d0-d59f-4a5d-aa21-374976075b98 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:33.271676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 493/995] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:33.277744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4288-3685-400b-a014-8d45b950dfbe None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:33.286581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4288-3685-400b-a014-8d45b950dfbe None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:33.291010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe50fc-cf1d-49a8-b686-4c36fcda00f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:33.291658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe50fc-cf1d-49a8-b686-4c36fcda00f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:33.291936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe50fc-cf1d-49a8-b686-4c36fcda00f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:33.292206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe50fc-cf1d-49a8-b686-4c36fcda00f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:33.292924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe50fc-cf1d-49a8-b686-4c36fcda00f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:33.294857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe50fc-cf1d-49a8-b686-4c36fcda00f1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:33.355334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 503/996] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:56:33 2021] POST /identity/v3/users => generated 285 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:34.388682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffef4-8702-4047-9478-3457b2bed0ed None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.389380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffef4-8702-4047-9478-3457b2bed0ed None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.389380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fffef4-8702-4047-9478-3457b2bed0ed None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.391021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 494/997] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:34.397727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1c320-844d-401b-bfaf-13f9f01d5311 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.398500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1c320-844d-401b-bfaf-13f9f01d5311 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.398781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1c320-844d-401b-bfaf-13f9f01d5311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.417994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a3b1c320-844d-401b-bfaf-13f9f01d5311 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:34.419125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a3b1c320-844d-401b-bfaf-13f9f01d5311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:34.427270 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 504/998] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:34.450391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fffef4-8702-4047-9478-3457b2bed0ed None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.462176 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fffef4-8702-4047-9478-3457b2bed0ed None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.466485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed84ff-5892-451a-a405-884b28a60d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.467310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed84ff-5892-451a-a405-884b28a60d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.467589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed84ff-5892-451a-a405-884b28a60d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.467859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed84ff-5892-451a-a405-884b28a60d92 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.478236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed84ff-5892-451a-a405-884b28a60d92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:34.485676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-7bed84ff-5892-451a-a405-884b28a60d92 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:56:34.487487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 495/999] 10.222.0.16 () {56 vars in 1141 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:34.495835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1c320-844d-401b-bfaf-13f9f01d5311 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.504581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1c320-844d-401b-bfaf-13f9f01d5311 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.508981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.509628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.509903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.510170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.510951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:34.511250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.512831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.520727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 505/1000] 10.222.0.16 () {56 vars in 1136 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:34.527123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed84ff-5892-451a-a405-884b28a60d92 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.537677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed84ff-5892-451a-a405-884b28a60d92 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.542119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.542918 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.543200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.543481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.553902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.555750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.572089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:34.573243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 496/1001] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:34.580140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.593175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da423c-7523-4055-9f2a-848dd7f8fade admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.599671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.600546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.600927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.601303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.602297 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:34.602731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.604734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.617162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 506/1002] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:34.623697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.633311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5faa-8c35-4465-9656-839d77ff5664 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.637753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.639587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.639873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.640147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.647225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.649231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.664104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:56:34.665357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 497/1003] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:34.671966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.682346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5f99-8f1b-462a-a09a-a77c32095e6f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.686922 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.687648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.687990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.688319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.689714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:34.690014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.691878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.710840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 507/1004] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:34.716961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.732921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb4bf-03e9-422d-99e3-1beb9585eac3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.738003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.739154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.739433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.739800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.749895 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.752410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.768996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:34.770363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 498/1005] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:34.776414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.785952 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea0e7e-bed8-4fe4-98e1-ae791fb1735f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.790404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.791143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.791487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.791825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.792609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:34.792977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.794645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.807508 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 508/1006] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:34.813828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.823925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7392a68-5589-4606-940b-9028ef0cdcdf admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.828386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.829147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.829431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.829692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.836259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.838222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.850776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:34.857880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 499/1007] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:34.857985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.868187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302723d-0870-443a-b4ae-e85532f50fa6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.873025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcfeae-90e4-4732-b59b-985890b7f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.873661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfeae-90e4-4732-b59b-985890b7f8ba admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.873944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfeae-90e4-4732-b59b-985890b7f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.874215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfeae-90e4-4732-b59b-985890b7f8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.875039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcfeae-90e4-4732-b59b-985890b7f8ba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:34.875346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcfeae-90e4-4732-b59b-985890b7f8ba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.877827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcfeae-90e4-4732-b59b-985890b7f8ba admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.889407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 509/1008] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:34.895923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:34.906013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df5f70-4a79-43a3-babe-579956721bb5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:34.910423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d46ed6-50e9-46c3-8128-d3c4457ed9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:34.911367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d46ed6-50e9-46c3-8128-d3c4457ed9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:34.911642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d46ed6-50e9-46c3-8128-d3c4457ed9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:34.911909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d46ed6-50e9-46c3-8128-d3c4457ed9f0 admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/0941777cfcbf4532be31ca001ced8aa7/roles/d9a01c5832ad4c4096bda26854053b9a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:34.914057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d46ed6-50e9-46c3-8128-d3c4457ed9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=0941777cfcbf4532be31ca001ced8aa7, role_id=d9a01c5832ad4c4096bda26854053b9a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:34.916678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d46ed6-50e9-46c3-8128-d3c4457ed9f0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:34.981471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 500/1009] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:56:34 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/0941777cfcbf4532be31ca001ced8aa7/roles/d9a01c5832ad4c4096bda26854053b9a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:56:35.677114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d70d0-f788-43d9-8700-74ee5f7141b6 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:35.677674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d70d0-f788-43d9-8700-74ee5f7141b6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:35.677674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d70d0-f788-43d9-8700-74ee5f7141b6 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:35.679479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 510/1010] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:35.685453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45272f1-967b-496f-89da-1dc558ae5ba1 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:35.685869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45272f1-967b-496f-89da-1dc558ae5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:35.686000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45272f1-967b-496f-89da-1dc558ae5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:35.703138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b45272f1-967b-496f-89da-1dc558ae5ba1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:35.704299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b45272f1-967b-496f-89da-1dc558ae5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:35.759989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 501/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:35.788640 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d70d0-f788-43d9-8700-74ee5f7141b6 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:35.801170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d70d0-f788-43d9-8700-74ee5f7141b6 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:35.805609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a3c8-9e8e-401e-8dcd-c50c20580b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:35.806400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a3c8-9e8e-401e-8dcd-c50c20580b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:35.806711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a3c8-9e8e-401e-8dcd-c50c20580b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:35.806985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a3c8-9e8e-401e-8dcd-c50c20580b2f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:35.817458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a3c8-9e8e-401e-8dcd-c50c20580b2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:35.824584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-62d0a3c8-9e8e-401e-8dcd-c50c20580b2f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:35.825783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 511/1012] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:35.833086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45272f1-967b-496f-89da-1dc558ae5ba1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:35.842069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45272f1-967b-496f-89da-1dc558ae5ba1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:35.848720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:35.849379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:35.855055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:35.855055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:35.855055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:35.855055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:35.855055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:35.861695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 502/1013] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:35.868647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a3c8-9e8e-401e-8dcd-c50c20580b2f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:35.879692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a3c8-9e8e-401e-8dcd-c50c20580b2f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:35.884212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13967bd-e907-4496-9085-de8c340c4b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:35.885050 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13967bd-e907-4496-9085-de8c340c4b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:35.885330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13967bd-e907-4496-9085-de8c340c4b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:35.885599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13967bd-e907-4496-9085-de8c340c4b11 admin admin] PATH_INFO: `/v3/users/b8d6bf7c218b4f95a7e24061c63a4f25` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:35.898999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13967bd-e907-4496-9085-de8c340c4b11 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8d6bf7c218b4f95a7e24061c63a4f25)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:35.901213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13967bd-e907-4496-9085-de8c340c4b11 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:35.902925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 512/1014] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:35 2021] GET /identity/v3/users/b8d6bf7c218b4f95a7e24061c63a4f25 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:35.909999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:35.919473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f6e56-c8af-4066-95f8-8c9d64357d90 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:35.923926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1ce4-8c9b-485d-ae99-aa17bf6461b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:35.924548 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1ce4-8c9b-485d-ae99-aa17bf6461b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:35.924829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1ce4-8c9b-485d-ae99-aa17bf6461b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:35.925105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1ce4-8c9b-485d-ae99-aa17bf6461b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:35.932797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b1ce4-8c9b-485d-ae99-aa17bf6461b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:35.934623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b1ce4-8c9b-485d-ae99-aa17bf6461b3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:35.943790 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 503/1015] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:35.950242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13967bd-e907-4496-9085-de8c340c4b11 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:35.960226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13967bd-e907-4496-9085-de8c340c4b11 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:35.964604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945844be-68b9-4c89-aea6-d5bafa49285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:35.965429 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945844be-68b9-4c89-aea6-d5bafa49285e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:35.965705 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945844be-68b9-4c89-aea6-d5bafa49285e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:35.965973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945844be-68b9-4c89-aea6-d5bafa49285e admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:35.967215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945844be-68b9-4c89-aea6-d5bafa49285e admin admin] RBAC: Authorizing `identity:get_project(project_id=1c0ef93ed47f47b48477133baa64eafa)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:35.969203 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945844be-68b9-4c89-aea6-d5bafa49285e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:35.970819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 513/1016] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:56:35 2021] GET /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:35.977086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1ce4-8c9b-485d-ae99-aa17bf6461b3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:35.985642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1ce4-8c9b-485d-ae99-aa17bf6461b3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:35.990365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe617bb-710b-4442-915f-88021111fb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:35.991020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe617bb-710b-4442-915f-88021111fb13 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:35.991304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe617bb-710b-4442-915f-88021111fb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:35.991578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe617bb-710b-4442-915f-88021111fb13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:35.992398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe617bb-710b-4442-915f-88021111fb13 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=1c0ef93ed47f47b48477133baa64eafa, user.id=b8d6bf7c218b4f95a7e24061c63a4f25) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:35.992708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe617bb-710b-4442-915f-88021111fb13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:35.994507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe617bb-710b-4442-915f-88021111fb13 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:35.999812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 504/1017] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:35 2021] GET /identity/v3/role_assignments?user.id=b8d6bf7c218b4f95a7e24061c63a4f25&scope.project.id=1c0ef93ed47f47b48477133baa64eafa&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:37.254894 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf14c1-3b9e-4130-a238-92d153d90ac3 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.255417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf14c1-3b9e-4130-a238-92d153d90ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.255505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf14c1-3b9e-4130-a238-92d153d90ac3 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.257202 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 514/1018] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:37.263230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eceeb-3428-4589-8c65-831489cf9ad6 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.263679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eceeb-3428-4589-8c65-831489cf9ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.263801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eceeb-3428-4589-8c65-831489cf9ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.281262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c21eceeb-3428-4589-8c65-831489cf9ad6 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:37.282440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c21eceeb-3428-4589-8c65-831489cf9ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:37.290428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 505/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:37.315730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf14c1-3b9e-4130-a238-92d153d90ac3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.328358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf14c1-3b9e-4130-a238-92d153d90ac3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.333174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef446f33-3679-4827-8c62-e6cbb248b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.333968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446f33-3679-4827-8c62-e6cbb248b4fe admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.334247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446f33-3679-4827-8c62-e6cbb248b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.334518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446f33-3679-4827-8c62-e6cbb248b4fe admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.344484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef446f33-3679-4827-8c62-e6cbb248b4fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:37.352564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-ef446f33-3679-4827-8c62-e6cbb248b4fe admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 11 16:56:37.353734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 515/1020] 10.222.0.16 () {56 vars in 1141 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:37.360473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eceeb-3428-4589-8c65-831489cf9ad6 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.369570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eceeb-3428-4589-8c65-831489cf9ad6 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.373982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.374670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.374953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.375226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.375979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:37.376284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.378345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.386703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 506/1021] 10.222.0.16 () {56 vars in 1136 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:37.394454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef446f33-3679-4827-8c62-e6cbb248b4fe admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.404759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef446f33-3679-4827-8c62-e6cbb248b4fe admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.409667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.410596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.411027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.411447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.425126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.427006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.445059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:37.446268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 516/1022] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:37.453372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.463810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f209fd8-8ace-4ad5-8d1c-ac4f60e48d90 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.468404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.469074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.469354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.469626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.470361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:37.470694 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.472303 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.484244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 507/1023] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:37.490917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.500356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf518-e7e3-4f49-9789-dd9cc119a18a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.505269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.506032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.506311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.506611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.513643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.515670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.530451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 11 16:56:37.531613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 517/1024] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:37.537911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.547410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484620f-4d61-46c4-aad6-c19aae686421 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.551935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.552585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.552866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.553142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.553973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:37.554282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.556132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.573109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 508/1025] 10.222.0.16 () {56 vars in 1154 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:37.579281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.589300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb8e96-a250-4cda-8dc7-b0296297ecfb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.593758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eeef4-416e-4c71-9035-b09ff38af730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.594392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eeef4-416e-4c71-9035-b09ff38af730 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.594704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eeef4-416e-4c71-9035-b09ff38af730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.594979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eeef4-416e-4c71-9035-b09ff38af730 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.604204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eeef4-416e-4c71-9035-b09ff38af730 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.605969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eeef4-416e-4c71-9035-b09ff38af730 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.616461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 518/1026] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:37.623071 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.633107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909211a-7b01-412b-bc5b-ddcc7c207aa6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.637662 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.638460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.638764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.639034 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.649926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.651797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.669726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:56:37.670911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 509/1027] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:37.678352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eeef4-416e-4c71-9035-b09ff38af730 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.687672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eeef4-416e-4c71-9035-b09ff38af730 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.692479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.693224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.693530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.693800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.694535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:37.694861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.696464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.708860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 519/1028] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:37.715236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.725669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d3ae8-a471-40b5-8ab6-7011c0dc8551 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.730262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.731083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.731363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.731663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.739626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.741582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.754956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:56:37.756199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 510/1029] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:37.763087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.773419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78e7ce-938f-4ea6-91fe-1e50a49cecb5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.777996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3808968-96e0-46c5-a557-98c006814ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.778690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808968-96e0-46c5-a557-98c006814ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.778970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808968-96e0-46c5-a557-98c006814ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.779241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808968-96e0-46c5-a557-98c006814ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.780034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3808968-96e0-46c5-a557-98c006814ccc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:37.780337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3808968-96e0-46c5-a557-98c006814ccc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.782175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3808968-96e0-46c5-a557-98c006814ccc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.795534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 520/1030] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:37.802672 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:37.812990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2dbc1-b77f-4cbf-a981-cff789fbb1e7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:37.817566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3a7e-2845-4c40-bd01-52b998c2a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:37.818262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3a7e-2845-4c40-bd01-52b998c2a39f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:37.818560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3a7e-2845-4c40-bd01-52b998c2a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:37.818838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3a7e-2845-4c40-bd01-52b998c2a39f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:37.819673 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3a7e-2845-4c40-bd01-52b998c2a39f admin admin] RBAC: Adding query filter params (role.id=d9a01c5832ad4c4096bda26854053b9a, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=0941777cfcbf4532be31ca001ced8aa7) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:37.819982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3a7e-2845-4c40-bd01-52b998c2a39f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:37.821827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3a7e-2845-4c40-bd01-52b998c2a39f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:37.828552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 511/1031] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:37 2021] GET /identity/v3/role_assignments?user.id=0941777cfcbf4532be31ca001ced8aa7&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9a01c5832ad4c4096bda26854053b9a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:38.269040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894527-f5a6-4c1d-a09f-af5a76408a7a None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:38.269546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894527-f5a6-4c1d-a09f-af5a76408a7a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:38.269652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894527-f5a6-4c1d-a09f-af5a76408a7a None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:38.271362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 521/1032] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:38.277523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111feed-119f-4b63-abe0-c4cfb8c2087d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:38.277982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111feed-119f-4b63-abe0-c4cfb8c2087d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:38.278075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111feed-119f-4b63-abe0-c4cfb8c2087d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:38.295142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3111feed-119f-4b63-abe0-c4cfb8c2087d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:38.296363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3111feed-119f-4b63-abe0-c4cfb8c2087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:38.304035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 512/1033] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:38.327782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d894527-f5a6-4c1d-a09f-af5a76408a7a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:38.341316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d894527-f5a6-4c1d-a09f-af5a76408a7a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:38.345875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f0083-1b10-4508-bf1d-e8e338013b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:38.346774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f0083-1b10-4508-bf1d-e8e338013b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:38.347052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f0083-1b10-4508-bf1d-e8e338013b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:38.347319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f0083-1b10-4508-bf1d-e8e338013b35 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:38.357843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f0083-1b10-4508-bf1d-e8e338013b35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:38.365198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-637f0083-1b10-4508-bf1d-e8e338013b35 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:38.366383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 522/1034] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:38.374738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111feed-119f-4b63-abe0-c4cfb8c2087d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:38.384502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111feed-119f-4b63-abe0-c4cfb8c2087d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:38.388948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:38.389616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:38.389914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:38.390172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:38.390960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:38.391270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:38.393399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:38.402060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 513/1035] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:38.408431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f0083-1b10-4508-bf1d-e8e338013b35 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:38.418707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f0083-1b10-4508-bf1d-e8e338013b35 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:38.423203 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5dae-14cc-4d1e-9c5f-92b753d65f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:38.424047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5dae-14cc-4d1e-9c5f-92b753d65f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:38.424327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5dae-14cc-4d1e-9c5f-92b753d65f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:38.424596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5dae-14cc-4d1e-9c5f-92b753d65f5d admin admin] PATH_INFO: `/v3/users/b8d6bf7c218b4f95a7e24061c63a4f25` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:38.425793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd5dae-14cc-4d1e-9c5f-92b753d65f5d admin admin] RBAC: Authorizing `identity:get_user(user_id=b8d6bf7c218b4f95a7e24061c63a4f25)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:38.427952 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd5dae-14cc-4d1e-9c5f-92b753d65f5d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:38.429677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 523/1036] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:38 2021] GET /identity/v3/users/b8d6bf7c218b4f95a7e24061c63a4f25 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:38.436017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:38.446275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfd040-39fd-405e-b753-35d9af6a1cbb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:38.450798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b1648-0acd-40f5-a77d-75860b4bb5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:38.451642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b1648-0acd-40f5-a77d-75860b4bb5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:38.451929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b1648-0acd-40f5-a77d-75860b4bb5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:38.452204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b1648-0acd-40f5-a77d-75860b4bb5eb admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:38.453412 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b1648-0acd-40f5-a77d-75860b4bb5eb admin admin] RBAC: Authorizing `identity:get_project(project_id=1c0ef93ed47f47b48477133baa64eafa)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:38.456041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b1648-0acd-40f5-a77d-75860b4bb5eb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:38.457743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 514/1037] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:56:38 2021] GET /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:38.464511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5dae-14cc-4d1e-9c5f-92b753d65f5d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:38.474321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5dae-14cc-4d1e-9c5f-92b753d65f5d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:38.478860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e7c65-37d7-4d34-9f37-959353022c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:38.479732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7c65-37d7-4d34-9f37-959353022c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:38.480011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7c65-37d7-4d34-9f37-959353022c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:38.480284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7c65-37d7-4d34-9f37-959353022c12 admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa/users/b8d6bf7c218b4f95a7e24061c63a4f25/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:38.482225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e7c65-37d7-4d34-9f37-959353022c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0ef93ed47f47b48477133baa64eafa, user_id=b8d6bf7c218b4f95a7e24061c63a4f25, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:38.484881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e7c65-37d7-4d34-9f37-959353022c12 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:38.561376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 524/1038] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:56:38 2021] PUT /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa/users/b8d6bf7c218b4f95a7e24061c63a4f25/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:56:40.820823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e5b19-e6f2-4b69-9e4e-6d0b278b1b37 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:40.821703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e5b19-e6f2-4b69-9e4e-6d0b278b1b37 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:40.821703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e5b19-e6f2-4b69-9e4e-6d0b278b1b37 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:40.823285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 515/1039] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:40.830492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747576e6-4a7f-441e-b0b0-157dadae54fb None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:40.831070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747576e6-4a7f-441e-b0b0-157dadae54fb None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:40.831070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747576e6-4a7f-441e-b0b0-157dadae54fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:40.849824 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-747576e6-4a7f-441e-b0b0-157dadae54fb None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:40.851079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-747576e6-4a7f-441e-b0b0-157dadae54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:40.917577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 525/1040] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:40.943365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e5b19-e6f2-4b69-9e4e-6d0b278b1b37 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:40.956242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e5b19-e6f2-4b69-9e4e-6d0b278b1b37 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:40.961108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e3b6f-1d19-4bbe-aaf5-2357fbfdde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:40.961893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e3b6f-1d19-4bbe-aaf5-2357fbfdde86 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:40.962168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e3b6f-1d19-4bbe-aaf5-2357fbfdde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:40.962436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e3b6f-1d19-4bbe-aaf5-2357fbfdde86 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:40.974190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e3b6f-1d19-4bbe-aaf5-2357fbfdde86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:40.981221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-662e3b6f-1d19-4bbe-aaf5-2357fbfdde86 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:40.982482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 516/1041] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:40.989890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747576e6-4a7f-441e-b0b0-157dadae54fb None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:40.998918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747576e6-4a7f-441e-b0b0-157dadae54fb None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:41.003554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:41.004219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:41.004500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:41.004773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:41.005526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:41.005832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:41.007464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:41.016055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 526/1042] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:41.023209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e3b6f-1d19-4bbe-aaf5-2357fbfdde86 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:41.033406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e3b6f-1d19-4bbe-aaf5-2357fbfdde86 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:41.038200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ff9e0-36cc-4384-aa00-546eb5a84f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:41.039193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff9e0-36cc-4384-aa00-546eb5a84f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:41.039491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff9e0-36cc-4384-aa00-546eb5a84f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:41.039774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff9e0-36cc-4384-aa00-546eb5a84f79 admin admin] PATH_INFO: `/v3/users/b8d6bf7c218b4f95a7e24061c63a4f25` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:41.041048 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ff9e0-36cc-4384-aa00-546eb5a84f79 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8d6bf7c218b4f95a7e24061c63a4f25)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:41.043273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ff9e0-36cc-4384-aa00-546eb5a84f79 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:41.044825 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 517/1043] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:41 2021] GET /identity/v3/users/b8d6bf7c218b4f95a7e24061c63a4f25 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:41.051879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:41.061367 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb763947-7588-4fd9-a4d8-1cc4eeb0722d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:41.065814 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581f04d-774c-4c5a-bcf2-71a74c2adfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:41.066430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581f04d-774c-4c5a-bcf2-71a74c2adfff admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:41.066734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581f04d-774c-4c5a-bcf2-71a74c2adfff admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:41.067003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581f04d-774c-4c5a-bcf2-71a74c2adfff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:41.074369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581f04d-774c-4c5a-bcf2-71a74c2adfff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:41.076123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581f04d-774c-4c5a-bcf2-71a74c2adfff admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:41.085120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 527/1044] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:41.091131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ff9e0-36cc-4384-aa00-546eb5a84f79 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:41.101238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ff9e0-36cc-4384-aa00-546eb5a84f79 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:41.105549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142f7b2-1df8-4d0b-b47d-e8aec53c154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:41.106363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f7b2-1df8-4d0b-b47d-e8aec53c154b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:41.106669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f7b2-1df8-4d0b-b47d-e8aec53c154b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:41.106941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f7b2-1df8-4d0b-b47d-e8aec53c154b admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:41.108100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142f7b2-1df8-4d0b-b47d-e8aec53c154b admin admin] RBAC: Authorizing `identity:get_project(project_id=1c0ef93ed47f47b48477133baa64eafa)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:41.110115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142f7b2-1df8-4d0b-b47d-e8aec53c154b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:41.111794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 518/1045] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:56:41 2021] GET /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:41.118773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581f04d-774c-4c5a-bcf2-71a74c2adfff admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:41.128096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581f04d-774c-4c5a-bcf2-71a74c2adfff admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:41.132590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836af03-9ac1-436e-be5a-2afa80feb0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:41.133219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836af03-9ac1-436e-be5a-2afa80feb0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:41.133494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836af03-9ac1-436e-be5a-2afa80feb0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:41.133760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836af03-9ac1-436e-be5a-2afa80feb0d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:41.134603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836af03-9ac1-436e-be5a-2afa80feb0d8 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=1c0ef93ed47f47b48477133baa64eafa, user.id=b8d6bf7c218b4f95a7e24061c63a4f25) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:41.134917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836af03-9ac1-436e-be5a-2afa80feb0d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:41.136723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836af03-9ac1-436e-be5a-2afa80feb0d8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:41.144118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 528/1046] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:41 2021] GET /identity/v3/role_assignments?user.id=b8d6bf7c218b4f95a7e24061c63a4f25&scope.project.id=1c0ef93ed47f47b48477133baa64eafa&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:43.473511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273282a9-869e-4fb8-82a0-ae4cd129d7cc None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:43.474014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273282a9-869e-4fb8-82a0-ae4cd129d7cc None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:43.474014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273282a9-869e-4fb8-82a0-ae4cd129d7cc None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:43.475745 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 519/1047] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:43.481818 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc4be-7bad-4b35-9b3b-33a1fd4f9990 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:43.482220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc4be-7bad-4b35-9b3b-33a1fd4f9990 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:43.482365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc4be-7bad-4b35-9b3b-33a1fd4f9990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:43.502840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a7ecc4be-7bad-4b35-9b3b-33a1fd4f9990 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:43.504015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a7ecc4be-7bad-4b35-9b3b-33a1fd4f9990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:43.511500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 529/1048] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 16:56:43.539086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273282a9-869e-4fb8-82a0-ae4cd129d7cc None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:43.551959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273282a9-869e-4fb8-82a0-ae4cd129d7cc None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:43.556481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c962eba-5ed9-40f2-b517-bd93253fde5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:43.557292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c962eba-5ed9-40f2-b517-bd93253fde5f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:43.557574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c962eba-5ed9-40f2-b517-bd93253fde5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:43.557851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c962eba-5ed9-40f2-b517-bd93253fde5f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:43.559123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c962eba-5ed9-40f2-b517-bd93253fde5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:43.560812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c962eba-5ed9-40f2-b517-bd93253fde5f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:43.562419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 520/1049] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:43.569052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecc4be-7bad-4b35-9b3b-33a1fd4f9990 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:43.578000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecc4be-7bad-4b35-9b3b-33a1fd4f9990 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:43.582453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb38af-4a33-42b5-85a0-cc8d9aa9d695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:43.583154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb38af-4a33-42b5-85a0-cc8d9aa9d695 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:43.583428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb38af-4a33-42b5-85a0-cc8d9aa9d695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:43.583696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb38af-4a33-42b5-85a0-cc8d9aa9d695 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:43.584417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb38af-4a33-42b5-85a0-cc8d9aa9d695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:43.586314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb38af-4a33-42b5-85a0-cc8d9aa9d695 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:43.669132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 530/1050] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:56:43 2021] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:45.992939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7998c-f3d5-470b-b5ed-af4f824d6662 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:45.993479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7998c-f3d5-470b-b5ed-af4f824d6662 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:45.993479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7998c-f3d5-470b-b5ed-af4f824d6662 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:45.995249 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 521/1051] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:46.001769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d419f-f3c7-4b56-af13-ac6a120d7604 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:46.002201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d419f-f3c7-4b56-af13-ac6a120d7604 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:46.002318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d419f-f3c7-4b56-af13-ac6a120d7604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:46.019510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b21d419f-f3c7-4b56-af13-ac6a120d7604 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:46.020692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b21d419f-f3c7-4b56-af13-ac6a120d7604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:46.028287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 531/1052] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:46.055198 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7998c-f3d5-470b-b5ed-af4f824d6662 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:46.067741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7998c-f3d5-470b-b5ed-af4f824d6662 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:46.072023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:46.072866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:46.073147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:46.073423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] PATH_INFO: `/v3/roles/c6ba186164fa477bb92f50bf3180c74d` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:46.074913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] RBAC: Authorizing `identity:get_role(role_id=c6ba186164fa477bb92f50bf3180c74d)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:46.075923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:46.075923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:56:46.075923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:56:46.076794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:46.078111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 522/1053] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:46 2021] GET /identity/v3/roles/c6ba186164fa477bb92f50bf3180c74d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:46.084586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d419f-f3c7-4b56-af13-ac6a120d7604 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:46.093456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d419f-f3c7-4b56-af13-ac6a120d7604 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:46.097935 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856fef0-4a69-4d9e-84ba-b82c344f13db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:46.098824 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856fef0-4a69-4d9e-84ba-b82c344f13db admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:46.099108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856fef0-4a69-4d9e-84ba-b82c344f13db admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:46.099406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856fef0-4a69-4d9e-84ba-b82c344f13db admin admin] PATH_INFO: `/v3/users/6aa5f349e7fb4b92ba925967800fb603` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:46.115021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856fef0-4a69-4d9e-84ba-b82c344f13db admin admin] RBAC: Authorizing `identity:get_user(user_id=6aa5f349e7fb4b92ba925967800fb603)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:46.117159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856fef0-4a69-4d9e-84ba-b82c344f13db admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:46.118886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 532/1054] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:46 2021] GET /identity/v3/users/6aa5f349e7fb4b92ba925967800fb603 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:46.125414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:46.135526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ca4ac-d5bd-4aeb-ab83-d51066a49cc8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:46.140005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b8fcf-19e9-45f4-9cf6-1137be646495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:46.140628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8fcf-19e9-45f4-9cf6-1137be646495 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:46.140909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8fcf-19e9-45f4-9cf6-1137be646495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:46.141184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b8fcf-19e9-45f4-9cf6-1137be646495 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:46.148813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b8fcf-19e9-45f4-9cf6-1137be646495 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:46.150562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b8fcf-19e9-45f4-9cf6-1137be646495 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:46.159414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 523/1055] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:46 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:46.166501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856fef0-4a69-4d9e-84ba-b82c344f13db admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:46.176527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856fef0-4a69-4d9e-84ba-b82c344f13db admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:46.181248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1681de-dc3c-49f5-b697-5cbaf07c640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:46.182112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1681de-dc3c-49f5-b697-5cbaf07c640e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:46.182379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1681de-dc3c-49f5-b697-5cbaf07c640e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:46.182678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1681de-dc3c-49f5-b697-5cbaf07c640e admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:46.183983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1681de-dc3c-49f5-b697-5cbaf07c640e admin admin] RBAC: Authorizing `identity:get_project(project_id=1c0ef93ed47f47b48477133baa64eafa)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:46.187709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1681de-dc3c-49f5-b697-5cbaf07c640e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:46.190803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 533/1056] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:56:46 2021] GET /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:46.199639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b8fcf-19e9-45f4-9cf6-1137be646495 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:46.208520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b8fcf-19e9-45f4-9cf6-1137be646495 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:46.213068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b9a4a-bde0-46db-b61f-eb96c00e6f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:46.213708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b9a4a-bde0-46db-b61f-eb96c00e6f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:46.213989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b9a4a-bde0-46db-b61f-eb96c00e6f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:46.214262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b9a4a-bde0-46db-b61f-eb96c00e6f24 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:46.215131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b9a4a-bde0-46db-b61f-eb96c00e6f24 admin admin] RBAC: Adding query filter params (role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=1c0ef93ed47f47b48477133baa64eafa, user.id=6aa5f349e7fb4b92ba925967800fb603) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:46.215441 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b9a4a-bde0-46db-b61f-eb96c00e6f24 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:46.217273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b9a4a-bde0-46db-b61f-eb96c00e6f24 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:46.222696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 524/1057] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:46 2021] GET /identity/v3/role_assignments?user.id=6aa5f349e7fb4b92ba925967800fb603&scope.project.id=1c0ef93ed47f47b48477133baa64eafa&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:48.505425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6626a1-e35b-4537-80fe-409f98a3c9a2 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:48.505948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6626a1-e35b-4537-80fe-409f98a3c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:48.505948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6626a1-e35b-4537-80fe-409f98a3c9a2 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:48.507664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 534/1058] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:48.513591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f94fbc-cf80-4c79-8157-23c1d6155c5c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:48.514002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f94fbc-cf80-4c79-8157-23c1d6155c5c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:48.514137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f94fbc-cf80-4c79-8157-23c1d6155c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:48.538024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-19f94fbc-cf80-4c79-8157-23c1d6155c5c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:48.539593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-19f94fbc-cf80-4c79-8157-23c1d6155c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:48.547405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 525/1059] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:48.575788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6626a1-e35b-4537-80fe-409f98a3c9a2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:48.587823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6626a1-e35b-4537-80fe-409f98a3c9a2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:48.592168 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:48.593000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:48.593281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:48.593555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] PATH_INFO: `/v3/roles/c6ba186164fa477bb92f50bf3180c74d` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:48.595545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] RBAC: Authorizing `identity:get_role(role_id=c6ba186164fa477bb92f50bf3180c74d)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:48.596552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:56:48.596552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 16:56:48.596552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 16:56:48.597417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:48.598798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 535/1060] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:48 2021] GET /identity/v3/roles/c6ba186164fa477bb92f50bf3180c74d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:48.605195 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f94fbc-cf80-4c79-8157-23c1d6155c5c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:48.614961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f94fbc-cf80-4c79-8157-23c1d6155c5c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:48.619457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b0544-3c53-4494-a1b3-c0503aaa111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:48.620326 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b0544-3c53-4494-a1b3-c0503aaa111e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:48.620606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b0544-3c53-4494-a1b3-c0503aaa111e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:48.620879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b0544-3c53-4494-a1b3-c0503aaa111e admin admin] PATH_INFO: `/v3/users/6aa5f349e7fb4b92ba925967800fb603` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:48.622074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b0544-3c53-4494-a1b3-c0503aaa111e admin admin] RBAC: Authorizing `identity:get_user(user_id=6aa5f349e7fb4b92ba925967800fb603)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:48.624254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b0544-3c53-4494-a1b3-c0503aaa111e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:48.625889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 526/1061] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:48 2021] GET /identity/v3/users/6aa5f349e7fb4b92ba925967800fb603 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:48.632330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:48.641871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddc142-599f-4081-844f-bcaeb3d22ea1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:48.646313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863285a-78b8-4ab4-a7f7-ab678b736667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:48.647181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863285a-78b8-4ab4-a7f7-ab678b736667 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:48.647462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863285a-78b8-4ab4-a7f7-ab678b736667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:48.647737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863285a-78b8-4ab4-a7f7-ab678b736667 admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:48.648913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863285a-78b8-4ab4-a7f7-ab678b736667 admin admin] RBAC: Authorizing `identity:get_project(project_id=1c0ef93ed47f47b48477133baa64eafa)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:48.650979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863285a-78b8-4ab4-a7f7-ab678b736667 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:48.652596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 536/1062] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:56:48 2021] GET /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:48.659535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b0544-3c53-4494-a1b3-c0503aaa111e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:48.669101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b0544-3c53-4494-a1b3-c0503aaa111e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:48.674245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a891f-d9f8-46c1-82ba-4e0375a9bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:48.675144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a891f-d9f8-46c1-82ba-4e0375a9bc70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:48.675426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a891f-d9f8-46c1-82ba-4e0375a9bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:48.675699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a891f-d9f8-46c1-82ba-4e0375a9bc70 admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa/users/6aa5f349e7fb4b92ba925967800fb603/roles/c6ba186164fa477bb92f50bf3180c74d` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:48.677904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a891f-d9f8-46c1-82ba-4e0375a9bc70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0ef93ed47f47b48477133baa64eafa, user_id=6aa5f349e7fb4b92ba925967800fb603, role_id=c6ba186164fa477bb92f50bf3180c74d)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:48.680548 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a891f-d9f8-46c1-82ba-4e0375a9bc70 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:48.760401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 527/1063] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:56:48 2021] PUT /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa/users/6aa5f349e7fb4b92ba925967800fb603/roles/c6ba186164fa477bb92f50bf3180c74d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:56:51.000526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5e73-73e6-4317-a4d6-b92ddf3a451b None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:51.001096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5e73-73e6-4317-a4d6-b92ddf3a451b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:51.001096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5e73-73e6-4317-a4d6-b92ddf3a451b None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:51.002848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 537/1064] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:51.008652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b3dc-82a8-4243-939b-681d47c5acba None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:51.009061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b3dc-82a8-4243-939b-681d47c5acba None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:51.009200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b3dc-82a8-4243-939b-681d47c5acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:51.025990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9562b3dc-82a8-4243-939b-681d47c5acba None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:51.027175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9562b3dc-82a8-4243-939b-681d47c5acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:51.081644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 528/1065] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:51.107752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea5e73-73e6-4317-a4d6-b92ddf3a451b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:51.120859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea5e73-73e6-4317-a4d6-b92ddf3a451b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:51.125102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e169-6763-45be-b0cc-baad0b38e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:51.125945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e169-6763-45be-b0cc-baad0b38e264 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:51.126216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e169-6763-45be-b0cc-baad0b38e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:51.126479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e169-6763-45be-b0cc-baad0b38e264 admin admin] PATH_INFO: `/v3/roles/c6ba186164fa477bb92f50bf3180c74d` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:51.127939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25e169-6763-45be-b0cc-baad0b38e264 admin admin] RBAC: Authorizing `identity:get_role(role_id=c6ba186164fa477bb92f50bf3180c74d)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:51.129507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25e169-6763-45be-b0cc-baad0b38e264 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:51.130821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 538/1066] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:51 2021] GET /identity/v3/roles/c6ba186164fa477bb92f50bf3180c74d => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:51.137069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b3dc-82a8-4243-939b-681d47c5acba None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:51.145657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b3dc-82a8-4243-939b-681d47c5acba None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:51.149980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c65b39-2d8a-4d00-a97d-bf1cf3aa336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:51.150855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c65b39-2d8a-4d00-a97d-bf1cf3aa336f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:51.151133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c65b39-2d8a-4d00-a97d-bf1cf3aa336f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:51.151401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c65b39-2d8a-4d00-a97d-bf1cf3aa336f admin admin] PATH_INFO: `/v3/users/6aa5f349e7fb4b92ba925967800fb603` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:51.152578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c65b39-2d8a-4d00-a97d-bf1cf3aa336f admin admin] RBAC: Authorizing `identity:get_user(user_id=6aa5f349e7fb4b92ba925967800fb603)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:51.154702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c65b39-2d8a-4d00-a97d-bf1cf3aa336f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:51.156251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 529/1067] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:51 2021] GET /identity/v3/users/6aa5f349e7fb4b92ba925967800fb603 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:51.163023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e169-6763-45be-b0cc-baad0b38e264 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:51.172326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e169-6763-45be-b0cc-baad0b38e264 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:51.177300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6362c2d-58e1-4a07-b839-3ebbd9301845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:51.177916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6362c2d-58e1-4a07-b839-3ebbd9301845 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:51.178191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6362c2d-58e1-4a07-b839-3ebbd9301845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:51.178461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6362c2d-58e1-4a07-b839-3ebbd9301845 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:51.185973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6362c2d-58e1-4a07-b839-3ebbd9301845 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:51.187725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6362c2d-58e1-4a07-b839-3ebbd9301845 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:51.196466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 539/1068] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:51 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 16:56:51.204205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c65b39-2d8a-4d00-a97d-bf1cf3aa336f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:51.213861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c65b39-2d8a-4d00-a97d-bf1cf3aa336f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:51.218453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a034-9bee-491a-a915-3b40886df6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:51.219341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a034-9bee-491a-a915-3b40886df6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:51.224144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a034-9bee-491a-a915-3b40886df6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:51.224421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a034-9bee-491a-a915-3b40886df6a0 admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:51.225614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958a034-9bee-491a-a915-3b40886df6a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1c0ef93ed47f47b48477133baa64eafa)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:51.227680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958a034-9bee-491a-a915-3b40886df6a0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:51.229331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 530/1069] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:56:51 2021] GET /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:51.237969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6362c2d-58e1-4a07-b839-3ebbd9301845 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:51.246919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6362c2d-58e1-4a07-b839-3ebbd9301845 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:51.252731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafbaab-6a7e-486c-9256-93736697aa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:51.253324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbaab-6a7e-486c-9256-93736697aa9b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:51.253602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbaab-6a7e-486c-9256-93736697aa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:51.253872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbaab-6a7e-486c-9256-93736697aa9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:51.254760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafbaab-6a7e-486c-9256-93736697aa9b admin admin] RBAC: Adding query filter params (role.id=c6ba186164fa477bb92f50bf3180c74d, scope.project.id=1c0ef93ed47f47b48477133baa64eafa, user.id=6aa5f349e7fb4b92ba925967800fb603) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:51.255069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafbaab-6a7e-486c-9256-93736697aa9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:51.256915 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafbaab-6a7e-486c-9256-93736697aa9b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:51.263535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 540/1070] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:51 2021] GET /identity/v3/role_assignments?user.id=6aa5f349e7fb4b92ba925967800fb603&scope.project.id=1c0ef93ed47f47b48477133baa64eafa&role.id=c6ba186164fa477bb92f50bf3180c74d => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:53.524720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b05aab-6237-4a81-a982-3ce3d3706996 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:53.525252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b05aab-6237-4a81-a982-3ce3d3706996 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:53.525252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b05aab-6237-4a81-a982-3ce3d3706996 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:53.527020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 531/1071] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:53.533876 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018f98c-fce9-41e7-9a38-ea17eb5a3bd9 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:53.534334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018f98c-fce9-41e7-9a38-ea17eb5a3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:53.534421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018f98c-fce9-41e7-9a38-ea17eb5a3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:53.551824 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c018f98c-fce9-41e7-9a38-ea17eb5a3bd9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:53.553012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c018f98c-fce9-41e7-9a38-ea17eb5a3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:53.560437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 541/1072] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:53.586600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b05aab-6237-4a81-a982-3ce3d3706996 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:53.600347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b05aab-6237-4a81-a982-3ce3d3706996 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:53.604934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825ec2c-38cf-4f86-af7f-7ce9c36f6cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:53.605709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ec2c-38cf-4f86-af7f-7ce9c36f6cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:53.606043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ec2c-38cf-4f86-af7f-7ce9c36f6cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:53.606315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825ec2c-38cf-4f86-af7f-7ce9c36f6cb3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:53.607581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825ec2c-38cf-4f86-af7f-7ce9c36f6cb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:53.609256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825ec2c-38cf-4f86-af7f-7ce9c36f6cb3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:53.610981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 532/1073] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:53.617887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018f98c-fce9-41e7-9a38-ea17eb5a3bd9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:53.626792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018f98c-fce9-41e7-9a38-ea17eb5a3bd9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:53.631262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96629-e3fc-42a0-a0ed-eee00000c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:53.631904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96629-e3fc-42a0-a0ed-eee00000c58f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:53.632182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96629-e3fc-42a0-a0ed-eee00000c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:53.632454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96629-e3fc-42a0-a0ed-eee00000c58f admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:53.633160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96629-e3fc-42a0-a0ed-eee00000c58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:53.635087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96629-e3fc-42a0-a0ed-eee00000c58f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:53.730385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 542/1074] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:56:53 2021] POST /identity/v3/projects => generated 311 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:56.057543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33b45-5937-49ea-88b7-1083748a1d31 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:56.058079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33b45-5937-49ea-88b7-1083748a1d31 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:56.058079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33b45-5937-49ea-88b7-1083748a1d31 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:56.059861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 533/1075] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:56.065746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cb06a-2875-4b1a-bae9-5dd9a76ac1c1 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:56.066118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cb06a-2875-4b1a-bae9-5dd9a76ac1c1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:56.066301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cb06a-2875-4b1a-bae9-5dd9a76ac1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:56.083948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-5d9cb06a-2875-4b1a-bae9-5dd9a76ac1c1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:56.085126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5d9cb06a-2875-4b1a-bae9-5dd9a76ac1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:56.140858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 543/1076] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:56.168293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e33b45-5937-49ea-88b7-1083748a1d31 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:56.180245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e33b45-5937-49ea-88b7-1083748a1d31 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:56.184703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0aee-f981-4d1b-b0c7-72a122c4d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:56.185465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0aee-f981-4d1b-b0c7-72a122c4d1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:56.185740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0aee-f981-4d1b-b0c7-72a122c4d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:56.186008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0aee-f981-4d1b-b0c7-72a122c4d1c3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:56.187194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0aee-f981-4d1b-b0c7-72a122c4d1c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:56.189465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0aee-f981-4d1b-b0c7-72a122c4d1c3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:56.191032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 534/1077] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:56:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:56.196983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cb06a-2875-4b1a-bae9-5dd9a76ac1c1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:56.206319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cb06a-2875-4b1a-bae9-5dd9a76ac1c1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:56.210813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8641b6-c37e-4c0e-862e-34847560c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:56.211464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8641b6-c37e-4c0e-862e-34847560c0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:56.211746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8641b6-c37e-4c0e-862e-34847560c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:56.212018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8641b6-c37e-4c0e-862e-34847560c0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:56.212723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8641b6-c37e-4c0e-862e-34847560c0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:56.214645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8641b6-c37e-4c0e-862e-34847560c0b5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:56.318641 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 544/1078] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:56:56 2021] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:56:58.650261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c452b-8e17-4164-98bc-723a7257bf16 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:58.650871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c452b-8e17-4164-98bc-723a7257bf16 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:58.650871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c452b-8e17-4164-98bc-723a7257bf16 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:58.652605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 535/1079] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:56:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:56:58.658874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68508000-4b3e-48a4-9030-c29a8ae41c35 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:58.659346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68508000-4b3e-48a4-9030-c29a8ae41c35 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:58.659434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68508000-4b3e-48a4-9030-c29a8ae41c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:58.676541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-68508000-4b3e-48a4-9030-c29a8ae41c35 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:56:58.677708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-68508000-4b3e-48a4-9030-c29a8ae41c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:56:58.685134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 545/1080] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:56:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:56:58.711763 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c452b-8e17-4164-98bc-723a7257bf16 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:58.723682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c452b-8e17-4164-98bc-723a7257bf16 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:58.727936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe02d3-4f17-46a1-9494-96cb59954748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:58.728714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe02d3-4f17-46a1-9494-96cb59954748 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:58.728991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe02d3-4f17-46a1-9494-96cb59954748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:58.729263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe02d3-4f17-46a1-9494-96cb59954748 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:58.740043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe02d3-4f17-46a1-9494-96cb59954748 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:56:58.746933 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-cffe02d3-4f17-46a1-9494-96cb59954748 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:56:58.748136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 536/1081] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:56:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:56:58.755497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68508000-4b3e-48a4-9030-c29a8ae41c35 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:58.764421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68508000-4b3e-48a4-9030-c29a8ae41c35 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:58.768857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:58.769515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:58.769792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:58.770062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:58.770848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:58.771149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:58.772716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:58.781340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 546/1082] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:56:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:58.790099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe02d3-4f17-46a1-9494-96cb59954748 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:58.800792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe02d3-4f17-46a1-9494-96cb59954748 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:58.805290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fef1d-7173-4194-a497-d8732b4f3cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:58.806150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fef1d-7173-4194-a497-d8732b4f3cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:58.806428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fef1d-7173-4194-a497-d8732b4f3cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:58.806729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fef1d-7173-4194-a497-d8732b4f3cf3 admin admin] PATH_INFO: `/v3/users/311c3582f0b94c29b2773959ebfc1954` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:58.820608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fef1d-7173-4194-a497-d8732b4f3cf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=311c3582f0b94c29b2773959ebfc1954)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:58.822779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fef1d-7173-4194-a497-d8732b4f3cf3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:58.824482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 537/1083] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:56:58 2021] GET /identity/v3/users/311c3582f0b94c29b2773959ebfc1954 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:58.831486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:58.841063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b057be4-6b6e-4194-96cb-0bd730a9d34c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:58.845589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f81d21-4db4-4c84-b28c-5112f1f51e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:58.858359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81d21-4db4-4c84-b28c-5112f1f51e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:58.858359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81d21-4db4-4c84-b28c-5112f1f51e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:58.858359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81d21-4db4-4c84-b28c-5112f1f51e97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:58.858359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f81d21-4db4-4c84-b28c-5112f1f51e97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:58.858359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f81d21-4db4-4c84-b28c-5112f1f51e97 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:58.867180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 547/1084] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:56:58 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:56:58.874079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fef1d-7173-4194-a497-d8732b4f3cf3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:58.884358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fef1d-7173-4194-a497-d8732b4f3cf3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:58.888823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d2df8-3bab-46c7-9f62-ada23468a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:58.889668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d2df8-3bab-46c7-9f62-ada23468a681 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:58.889945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d2df8-3bab-46c7-9f62-ada23468a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:58.890215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d2df8-3bab-46c7-9f62-ada23468a681 admin admin] PATH_INFO: `/v3/projects/15ab56ee3e35403290da0cc00044d7bb` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:58.891414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d2df8-3bab-46c7-9f62-ada23468a681 admin admin] RBAC: Authorizing `identity:get_project(project_id=15ab56ee3e35403290da0cc00044d7bb)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:58.893436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d2df8-3bab-46c7-9f62-ada23468a681 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:58.895177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 538/1085] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:56:58 2021] GET /identity/v3/projects/15ab56ee3e35403290da0cc00044d7bb => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:56:58.902148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f81d21-4db4-4c84-b28c-5112f1f51e97 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:56:58.911349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f81d21-4db4-4c84-b28c-5112f1f51e97 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:56:58.915921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77537a49-b3ed-4f8a-a51c-82ca898bd5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:56:58.916568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537a49-b3ed-4f8a-a51c-82ca898bd5ed admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:56:58.916848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537a49-b3ed-4f8a-a51c-82ca898bd5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:56:58.917120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537a49-b3ed-4f8a-a51c-82ca898bd5ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:56:58.917951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77537a49-b3ed-4f8a-a51c-82ca898bd5ed admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=15ab56ee3e35403290da0cc00044d7bb, user.id=311c3582f0b94c29b2773959ebfc1954) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:56:58.918260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77537a49-b3ed-4f8a-a51c-82ca898bd5ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:56:58.920190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77537a49-b3ed-4f8a-a51c-82ca898bd5ed admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:56:58.926635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 548/1086] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:56:58 2021] GET /identity/v3/role_assignments?user.id=311c3582f0b94c29b2773959ebfc1954&scope.project.id=15ab56ee3e35403290da0cc00044d7bb&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:57:01.203698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5526af8-7ff3-4a94-bad8-5fce7286dfaa None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:01.204256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5526af8-7ff3-4a94-bad8-5fce7286dfaa None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:01.204256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5526af8-7ff3-4a94-bad8-5fce7286dfaa None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:01.205993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 539/1087] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:01.212001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb8fd4-1af8-43cf-a8d1-6f4f8507301a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:01.212440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb8fd4-1af8-43cf-a8d1-6f4f8507301a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:01.212541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb8fd4-1af8-43cf-a8d1-6f4f8507301a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:01.229822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2ecb8fd4-1af8-43cf-a8d1-6f4f8507301a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:01.231027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2ecb8fd4-1af8-43cf-a8d1-6f4f8507301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:01.239311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 549/1088] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:01.263140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5526af8-7ff3-4a94-bad8-5fce7286dfaa None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:01.275251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5526af8-7ff3-4a94-bad8-5fce7286dfaa None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:01.279428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86ccc-fd03-4e0a-977f-f35972aefc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:01.280191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86ccc-fd03-4e0a-977f-f35972aefc43 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:01.280465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86ccc-fd03-4e0a-977f-f35972aefc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:01.280732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f86ccc-fd03-4e0a-977f-f35972aefc43 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:01.290356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f86ccc-fd03-4e0a-977f-f35972aefc43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:57:01.297762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-06f86ccc-fd03-4e0a-977f-f35972aefc43 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:57:01.298941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 540/1089] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:57:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:57:01.307272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb8fd4-1af8-43cf-a8d1-6f4f8507301a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:01.317186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb8fd4-1af8-43cf-a8d1-6f4f8507301a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:01.322086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:01.322780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:01.323070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:01.323339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:01.324095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:01.324394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:01.325979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:01.334907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 550/1090] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:57:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:01.341370 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86ccc-fd03-4e0a-977f-f35972aefc43 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:01.351903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f86ccc-fd03-4e0a-977f-f35972aefc43 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:01.356273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede76ae-5ec4-4c7f-9920-87f64cf5173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:01.357104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede76ae-5ec4-4c7f-9920-87f64cf5173f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:01.357379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede76ae-5ec4-4c7f-9920-87f64cf5173f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:01.357645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede76ae-5ec4-4c7f-9920-87f64cf5173f admin admin] PATH_INFO: `/v3/users/311c3582f0b94c29b2773959ebfc1954` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:01.358844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede76ae-5ec4-4c7f-9920-87f64cf5173f admin admin] RBAC: Authorizing `identity:get_user(user_id=311c3582f0b94c29b2773959ebfc1954)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:01.361506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede76ae-5ec4-4c7f-9920-87f64cf5173f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:01.363347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 541/1091] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:57:01 2021] GET /identity/v3/users/311c3582f0b94c29b2773959ebfc1954 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:01.369688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:01.379421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e4a9a-68c2-45bb-aeac-d87283c4b2ce admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:01.383895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667e6ea-2d33-4128-b0d9-3e1b7f95dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:01.384735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e6ea-2d33-4128-b0d9-3e1b7f95dd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:01.385016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e6ea-2d33-4128-b0d9-3e1b7f95dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:01.385287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e6ea-2d33-4128-b0d9-3e1b7f95dd42 admin admin] PATH_INFO: `/v3/projects/15ab56ee3e35403290da0cc00044d7bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:01.386453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667e6ea-2d33-4128-b0d9-3e1b7f95dd42 admin admin] RBAC: Authorizing `identity:get_project(project_id=15ab56ee3e35403290da0cc00044d7bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:01.388521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667e6ea-2d33-4128-b0d9-3e1b7f95dd42 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:01.390156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 551/1092] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:57:01 2021] GET /identity/v3/projects/15ab56ee3e35403290da0cc00044d7bb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:01.396698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede76ae-5ec4-4c7f-9920-87f64cf5173f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:01.406043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede76ae-5ec4-4c7f-9920-87f64cf5173f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:01.411001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba8f57-9214-4b94-b66c-1dcf12739a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:01.411803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8f57-9214-4b94-b66c-1dcf12739a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:01.412079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8f57-9214-4b94-b66c-1dcf12739a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:01.412353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8f57-9214-4b94-b66c-1dcf12739a6f admin admin] PATH_INFO: `/v3/projects/15ab56ee3e35403290da0cc00044d7bb/users/311c3582f0b94c29b2773959ebfc1954/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:01.414264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba8f57-9214-4b94-b66c-1dcf12739a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ab56ee3e35403290da0cc00044d7bb, user_id=311c3582f0b94c29b2773959ebfc1954, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:01.416928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba8f57-9214-4b94-b66c-1dcf12739a6f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:01.491804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 542/1093] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:57:01 2021] PUT /identity/v3/projects/15ab56ee3e35403290da0cc00044d7bb/users/311c3582f0b94c29b2773959ebfc1954/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:57:03.756523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa27a8-b924-45f9-b8c5-35f16887a6bf None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:03.757081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa27a8-b924-45f9-b8c5-35f16887a6bf None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:03.757081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa27a8-b924-45f9-b8c5-35f16887a6bf None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:03.758871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 552/1094] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:03.764769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879adfe-53c3-4faf-b887-55931606acab None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:03.765207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879adfe-53c3-4faf-b887-55931606acab None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:03.765310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879adfe-53c3-4faf-b887-55931606acab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:03.783931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c879adfe-53c3-4faf-b887-55931606acab None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:03.785107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c879adfe-53c3-4faf-b887-55931606acab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:03.839749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 543/1095] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:03.865406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa27a8-b924-45f9-b8c5-35f16887a6bf None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:03.877864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa27a8-b924-45f9-b8c5-35f16887a6bf None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:03.882169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee82e1-b88c-484e-94f8-c51797859b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:03.882979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee82e1-b88c-484e-94f8-c51797859b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:03.883261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee82e1-b88c-484e-94f8-c51797859b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:03.883535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee82e1-b88c-484e-94f8-c51797859b98 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:03.893996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee82e1-b88c-484e-94f8-c51797859b98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:57:03.900964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-b0ee82e1-b88c-484e-94f8-c51797859b98 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:57:03.902111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 553/1096] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:57:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:57:03.908877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879adfe-53c3-4faf-b887-55931606acab None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:03.917618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879adfe-53c3-4faf-b887-55931606acab None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:03.922314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:03.923230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:03.923506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:03.923771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:03.924525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:03.924823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:03.926410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:03.940622 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 544/1097] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:57:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:03.947188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee82e1-b88c-484e-94f8-c51797859b98 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:03.958096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee82e1-b88c-484e-94f8-c51797859b98 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:03.962687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff346ee-a73a-490b-8087-9d869de403ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:03.963543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff346ee-a73a-490b-8087-9d869de403ef admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:03.963821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff346ee-a73a-490b-8087-9d869de403ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:03.964092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff346ee-a73a-490b-8087-9d869de403ef admin admin] PATH_INFO: `/v3/users/311c3582f0b94c29b2773959ebfc1954` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:03.965315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff346ee-a73a-490b-8087-9d869de403ef admin admin] RBAC: Authorizing `identity:get_user(user_id=311c3582f0b94c29b2773959ebfc1954)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:03.967478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff346ee-a73a-490b-8087-9d869de403ef admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:03.969083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 554/1098] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:57:03 2021] GET /identity/v3/users/311c3582f0b94c29b2773959ebfc1954 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:03.976332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:03.990248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf672ff8-d334-4d07-8e3e-525957e43d44 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:03.994760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1219-3005-4341-b94d-32db15900788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:03.995387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1219-3005-4341-b94d-32db15900788 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:03.995666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1219-3005-4341-b94d-32db15900788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:03.995937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1219-3005-4341-b94d-32db15900788 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:04.004580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf1219-3005-4341-b94d-32db15900788 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:04.006331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf1219-3005-4341-b94d-32db15900788 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:04.015269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 545/1099] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:57:03 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:57:04.021776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff346ee-a73a-490b-8087-9d869de403ef admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:04.031204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff346ee-a73a-490b-8087-9d869de403ef admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:04.035615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f709dd-7db9-4a41-97b9-a29c0aa6cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:04.036457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f709dd-7db9-4a41-97b9-a29c0aa6cfec admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:04.036728 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f709dd-7db9-4a41-97b9-a29c0aa6cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:04.037001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f709dd-7db9-4a41-97b9-a29c0aa6cfec admin admin] PATH_INFO: `/v3/projects/15ab56ee3e35403290da0cc00044d7bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:04.038147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f709dd-7db9-4a41-97b9-a29c0aa6cfec admin admin] RBAC: Authorizing `identity:get_project(project_id=15ab56ee3e35403290da0cc00044d7bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:04.040212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f709dd-7db9-4a41-97b9-a29c0aa6cfec admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:04.041827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 555/1100] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:57:04 2021] GET /identity/v3/projects/15ab56ee3e35403290da0cc00044d7bb => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:04.048993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1219-3005-4341-b94d-32db15900788 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:04.057596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1219-3005-4341-b94d-32db15900788 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:04.061985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215b1fc-ac71-4106-bb19-b3a6f7288510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:04.063306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b1fc-ac71-4106-bb19-b3a6f7288510 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:04.063583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b1fc-ac71-4106-bb19-b3a6f7288510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:04.063853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b1fc-ac71-4106-bb19-b3a6f7288510 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:04.064668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215b1fc-ac71-4106-bb19-b3a6f7288510 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=15ab56ee3e35403290da0cc00044d7bb, user.id=311c3582f0b94c29b2773959ebfc1954) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:04.064972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215b1fc-ac71-4106-bb19-b3a6f7288510 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:04.066808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215b1fc-ac71-4106-bb19-b3a6f7288510 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:04.072482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 546/1101] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:57:04 2021] GET /identity/v3/role_assignments?user.id=311c3582f0b94c29b2773959ebfc1954&scope.project.id=15ab56ee3e35403290da0cc00044d7bb&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:06.379323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b10bd-3450-47e8-815e-03469e3e0153 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:06.379874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b10bd-3450-47e8-815e-03469e3e0153 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:06.379874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b10bd-3450-47e8-815e-03469e3e0153 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:06.381615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 556/1102] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:06.387691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65305-eb6a-4c53-998b-644683dabb8e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:06.388091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65305-eb6a-4c53-998b-644683dabb8e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:06.388235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65305-eb6a-4c53-998b-644683dabb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:06.405748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ace65305-eb6a-4c53-998b-644683dabb8e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:06.407697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ace65305-eb6a-4c53-998b-644683dabb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:06.415057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 547/1103] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:06.437784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b10bd-3450-47e8-815e-03469e3e0153 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:06.449490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b10bd-3450-47e8-815e-03469e3e0153 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:06.454272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db176f-fd4c-4262-9e14-b953cbb7ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:06.454929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db176f-fd4c-4262-9e14-b953cbb7ce0d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:06.455206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db176f-fd4c-4262-9e14-b953cbb7ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:06.455479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db176f-fd4c-4262-9e14-b953cbb7ce0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:06.462863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db176f-fd4c-4262-9e14-b953cbb7ce0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:06.464592 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db176f-fd4c-4262-9e14-b953cbb7ce0d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:06.473693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 557/1104] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:57:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:57:06.481161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace65305-eb6a-4c53-998b-644683dabb8e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:06.489910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace65305-eb6a-4c53-998b-644683dabb8e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:06.494221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e281c6b-5990-4a66-95b2-4663a3ec8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:06.495026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e281c6b-5990-4a66-95b2-4663a3ec8e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:06.495301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e281c6b-5990-4a66-95b2-4663a3ec8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:06.495566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e281c6b-5990-4a66-95b2-4663a3ec8e7d admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:06.502015 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e281c6b-5990-4a66-95b2-4663a3ec8e7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:06.503838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e281c6b-5990-4a66-95b2-4663a3ec8e7d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:06.517366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-4e281c6b-5990-4a66-95b2-4663a3ec8e7d admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 11 16:57:06.518441 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 548/1105] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:57:06 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:57:06.524698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db176f-fd4c-4262-9e14-b953cbb7ce0d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:06.533886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db176f-fd4c-4262-9e14-b953cbb7ce0d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:06.538350 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a94503-438d-4b3e-adbd-7964e0b82055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:06.539016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a94503-438d-4b3e-adbd-7964e0b82055 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:06.539298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a94503-438d-4b3e-adbd-7964e0b82055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:06.539573 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a94503-438d-4b3e-adbd-7964e0b82055 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:06.540287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a94503-438d-4b3e-adbd-7964e0b82055 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:06.540591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a94503-438d-4b3e-adbd-7964e0b82055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:06.542147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a94503-438d-4b3e-adbd-7964e0b82055 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:06.549266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 558/1106] 10.222.0.16 () {56 vars in 1136 bytes} [Thu Nov 11 16:57:06 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:08.836656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468d6b5-9a72-4b64-ba52-d736e8b5960d None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:08.837187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468d6b5-9a72-4b64-ba52-d736e8b5960d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:08.837187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468d6b5-9a72-4b64-ba52-d736e8b5960d None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:08.838985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 549/1107] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:08.845663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39801b9d-4423-484c-8d22-c82bb1c6dbaf None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:08.846045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39801b9d-4423-484c-8d22-c82bb1c6dbaf None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:08.846209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39801b9d-4423-484c-8d22-c82bb1c6dbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:08.863329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-39801b9d-4423-484c-8d22-c82bb1c6dbaf None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:08.864478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-39801b9d-4423-484c-8d22-c82bb1c6dbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:08.872044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 559/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:08.897864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468d6b5-9a72-4b64-ba52-d736e8b5960d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:08.909688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468d6b5-9a72-4b64-ba52-d736e8b5960d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:08.914137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f434b5-a1d5-47c6-94f0-551fa66c7352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:08.914803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f434b5-a1d5-47c6-94f0-551fa66c7352 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:08.915084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f434b5-a1d5-47c6-94f0-551fa66c7352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:08.915356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f434b5-a1d5-47c6-94f0-551fa66c7352 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:08.916105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f434b5-a1d5-47c6-94f0-551fa66c7352 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:08.917093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-71f434b5-a1d5-47c6-94f0-551fa66c7352 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 16:57:08.917093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 16:57:08.917093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 16:57:08.917955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f434b5-a1d5-47c6-94f0-551fa66c7352 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:08.994903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 550/1109] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Nov 11 16:57:08 2021] POST /identity/v3/domains => generated 267 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:57:11.256175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81a70-4724-479f-a4cd-10176664f1fc None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:11.256722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81a70-4724-479f-a4cd-10176664f1fc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:11.256722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81a70-4724-479f-a4cd-10176664f1fc None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:11.258444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 560/1110] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:11.264423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371a09-1610-4bd3-963e-b83136726bf0 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:11.264850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371a09-1610-4bd3-963e-b83136726bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:11.265552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371a09-1610-4bd3-963e-b83136726bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:11.282635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6a371a09-1610-4bd3-963e-b83136726bf0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:11.283802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6a371a09-1610-4bd3-963e-b83136726bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:11.357263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 551/1111] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:11.383812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81a70-4724-479f-a4cd-10176664f1fc None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:11.396359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81a70-4724-479f-a4cd-10176664f1fc None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:11.400684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539559b7-f206-4fea-886d-6d0ab08f2c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:11.401532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539559b7-f206-4fea-886d-6d0ab08f2c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:11.401809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539559b7-f206-4fea-886d-6d0ab08f2c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:11.402082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539559b7-f206-4fea-886d-6d0ab08f2c34 admin admin] PATH_INFO: `/v3/domains/2700b8b1fc2d4677b4ccd46f5d9d2d62` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:11.412974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539559b7-f206-4fea-886d-6d0ab08f2c34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=2700b8b1fc2d4677b4ccd46f5d9d2d62)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:11.414919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539559b7-f206-4fea-886d-6d0ab08f2c34 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:11.416578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 561/1112] 10.222.0.16 () {56 vars in 1204 bytes} [Thu Nov 11 16:57:11 2021] GET /identity/v3/domains/2700b8b1fc2d4677b4ccd46f5d9d2d62 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:11.423315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a371a09-1610-4bd3-963e-b83136726bf0 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:11.432079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a371a09-1610-4bd3-963e-b83136726bf0 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:11.436517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138606ec-888b-4986-8998-07fb922b8fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:11.437655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138606ec-888b-4986-8998-07fb922b8fde admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:11.437932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138606ec-888b-4986-8998-07fb922b8fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:11.438204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138606ec-888b-4986-8998-07fb922b8fde admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:11.438945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138606ec-888b-4986-8998-07fb922b8fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:11.440800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138606ec-888b-4986-8998-07fb922b8fde admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:11.534808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 552/1113] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:57:11 2021] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:57:13.812299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2806-c1a1-4d7d-9c36-3aa1e2db7eb2 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:13.812854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2806-c1a1-4d7d-9c36-3aa1e2db7eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:13.812854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2806-c1a1-4d7d-9c36-3aa1e2db7eb2 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:13.814633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 562/1114] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:13.820688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a571e-40ae-4353-8424-6e51d72b3a2c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:13.821087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a571e-40ae-4353-8424-6e51d72b3a2c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:13.821244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a571e-40ae-4353-8424-6e51d72b3a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:13.838730 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-619a571e-40ae-4353-8424-6e51d72b3a2c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:13.839892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-619a571e-40ae-4353-8424-6e51d72b3a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:13.893901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 553/1115] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:13.921109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b2806-c1a1-4d7d-9c36-3aa1e2db7eb2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:13.932886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b2806-c1a1-4d7d-9c36-3aa1e2db7eb2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:13.937112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b29b5c-6dba-4716-9f26-7636865adfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:13.937942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b29b5c-6dba-4716-9f26-7636865adfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:13.938214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b29b5c-6dba-4716-9f26-7636865adfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:13.938483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b29b5c-6dba-4716-9f26-7636865adfe9 admin admin] PATH_INFO: `/v3/domains/2700b8b1fc2d4677b4ccd46f5d9d2d62` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:13.939657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b29b5c-6dba-4716-9f26-7636865adfe9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=2700b8b1fc2d4677b4ccd46f5d9d2d62)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:13.941601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b29b5c-6dba-4716-9f26-7636865adfe9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:13.943151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 563/1116] 10.222.0.16 () {56 vars in 1204 bytes} [Thu Nov 11 16:57:13 2021] GET /identity/v3/domains/2700b8b1fc2d4677b4ccd46f5d9d2d62 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:13.949351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a571e-40ae-4353-8424-6e51d72b3a2c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:13.958514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a571e-40ae-4353-8424-6e51d72b3a2c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:13.962961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7df10-1697-409b-977d-e0931c1d4760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:13.963609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7df10-1697-409b-977d-e0931c1d4760 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:13.963889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7df10-1697-409b-977d-e0931c1d4760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:13.964164 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7df10-1697-409b-977d-e0931c1d4760 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:13.964885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7df10-1697-409b-977d-e0931c1d4760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:13.966801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7df10-1697-409b-977d-e0931c1d4760 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:14.067115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 554/1117] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:57:13 2021] POST /identity/v3/users => generated 311 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 16:57:16.344583 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795da274-0ad2-4021-be29-868f70ebb096 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:16.345257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795da274-0ad2-4021-be29-868f70ebb096 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:16.345257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795da274-0ad2-4021-be29-868f70ebb096 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:16.346908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 564/1118] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:16.352802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0d540-338d-4f4a-ac7e-46522135c08e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:16.353233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0d540-338d-4f4a-ac7e-46522135c08e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:16.353349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0d540-338d-4f4a-ac7e-46522135c08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:16.371290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9ee0d540-338d-4f4a-ac7e-46522135c08e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:16.372471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9ee0d540-338d-4f4a-ac7e-46522135c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:16.380009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 555/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:16.406343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795da274-0ad2-4021-be29-868f70ebb096 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:16.418280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795da274-0ad2-4021-be29-868f70ebb096 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:16.423219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba2f4-a485-4c3b-9944-ff0f3cd5b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:16.423990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba2f4-a485-4c3b-9944-ff0f3cd5b3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:16.424267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba2f4-a485-4c3b-9944-ff0f3cd5b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:16.424540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba2f4-a485-4c3b-9944-ff0f3cd5b3d8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:16.434934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba2f4-a485-4c3b-9944-ff0f3cd5b3d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:57:16.441794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-1f5ba2f4-a485-4c3b-9944-ff0f3cd5b3d8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:57:16.442949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 565/1120] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:57:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:57:16.449764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0d540-338d-4f4a-ac7e-46522135c08e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:16.458600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0d540-338d-4f4a-ac7e-46522135c08e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:16.463126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:16.463772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:16.464056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:16.464332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:16.465084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:16.465389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:16.467012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:16.475500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 556/1121] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:57:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:16.481884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba2f4-a485-4c3b-9944-ff0f3cd5b3d8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:16.492184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba2f4-a485-4c3b-9944-ff0f3cd5b3d8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:16.496666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6e5d1-089b-4859-9958-6f1b48003d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:16.497490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e5d1-089b-4859-9958-6f1b48003d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:16.497770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e5d1-089b-4859-9958-6f1b48003d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:16.498039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e5d1-089b-4859-9958-6f1b48003d07 admin admin] PATH_INFO: `/v3/users/e857abeb60bc4dc1a4e77460d99e20c2` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:16.511014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6e5d1-089b-4859-9958-6f1b48003d07 admin admin] RBAC: Authorizing `identity:get_user(user_id=e857abeb60bc4dc1a4e77460d99e20c2)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:16.513146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6e5d1-089b-4859-9958-6f1b48003d07 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:16.514742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 566/1122] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:57:16 2021] GET /identity/v3/users/e857abeb60bc4dc1a4e77460d99e20c2 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:16.521465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:16.531264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e660100-40f4-49c0-8603-2fd891afb34a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:16.535629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a003a-6564-4a4f-9170-592af1903515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:16.536248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a003a-6564-4a4f-9170-592af1903515 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:16.536526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a003a-6564-4a4f-9170-592af1903515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:16.536799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a003a-6564-4a4f-9170-592af1903515 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:16.544245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a003a-6564-4a4f-9170-592af1903515 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:16.546624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a003a-6564-4a4f-9170-592af1903515 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:16.555105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 557/1123] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:57:16 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:57:16.561223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6e5d1-089b-4859-9958-6f1b48003d07 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:16.570505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6e5d1-089b-4859-9958-6f1b48003d07 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:16.575112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b4c34-0e96-48a4-87dd-b684d6bc88c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:16.575935 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b4c34-0e96-48a4-87dd-b684d6bc88c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:16.576214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b4c34-0e96-48a4-87dd-b684d6bc88c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:16.576741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b4c34-0e96-48a4-87dd-b684d6bc88c5 admin admin] PATH_INFO: `/v3/projects/bad71aad432042d8a59a9569f81a090e` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:16.577658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b4c34-0e96-48a4-87dd-b684d6bc88c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=bad71aad432042d8a59a9569f81a090e)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:16.579730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b4c34-0e96-48a4-87dd-b684d6bc88c5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:16.581322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 567/1124] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:57:16 2021] GET /identity/v3/projects/bad71aad432042d8a59a9569f81a090e => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:16.587626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a003a-6564-4a4f-9170-592af1903515 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:16.596616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a003a-6564-4a4f-9170-592af1903515 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:16.601079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7a5c2-e23b-48db-bf25-98d4dff346f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:16.601697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7a5c2-e23b-48db-bf25-98d4dff346f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:16.601976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7a5c2-e23b-48db-bf25-98d4dff346f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:16.602250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7a5c2-e23b-48db-bf25-98d4dff346f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:16.603108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7a5c2-e23b-48db-bf25-98d4dff346f2 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=bad71aad432042d8a59a9569f81a090e, user.id=e857abeb60bc4dc1a4e77460d99e20c2) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:16.603417 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7a5c2-e23b-48db-bf25-98d4dff346f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:16.605209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7a5c2-e23b-48db-bf25-98d4dff346f2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:16.611290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 558/1125] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:57:16 2021] GET /identity/v3/role_assignments?user.id=e857abeb60bc4dc1a4e77460d99e20c2&scope.project.id=bad71aad432042d8a59a9569f81a090e&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:18.848608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff749-963c-47a8-b1b4-c60b446bbb7f None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:18.849139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff749-963c-47a8-b1b4-c60b446bbb7f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:18.849139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff749-963c-47a8-b1b4-c60b446bbb7f None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:18.850940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 568/1126] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:18.857049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6df91-4ab9-423d-91bf-6bd0c3d69294 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:18.857463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6df91-4ab9-423d-91bf-6bd0c3d69294 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:18.857593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6df91-4ab9-423d-91bf-6bd0c3d69294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:18.875309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a9e6df91-4ab9-423d-91bf-6bd0c3d69294 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:18.876592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a9e6df91-4ab9-423d-91bf-6bd0c3d69294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:18.883919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 559/1127] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:18.908100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff749-963c-47a8-b1b4-c60b446bbb7f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:18.920035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff749-963c-47a8-b1b4-c60b446bbb7f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:18.924626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053f12-469e-4b36-ab89-c62be3e08198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:18.925394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053f12-469e-4b36-ab89-c62be3e08198 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:18.925668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053f12-469e-4b36-ab89-c62be3e08198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:18.925935 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053f12-469e-4b36-ab89-c62be3e08198 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:18.935779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04053f12-469e-4b36-ab89-c62be3e08198 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:57:18.943240 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-04053f12-469e-4b36-ab89-c62be3e08198 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:57:18.944378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 569/1128] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:57:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:57:18.952947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6df91-4ab9-423d-91bf-6bd0c3d69294 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:18.961643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6df91-4ab9-423d-91bf-6bd0c3d69294 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:18.965953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:18.966617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:18.966897 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:18.967167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:18.969824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:18.970139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:18.972310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:18.981396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 560/1129] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:57:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:18.988826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053f12-469e-4b36-ab89-c62be3e08198 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:18.999849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053f12-469e-4b36-ab89-c62be3e08198 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:19.004239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad835-8662-44e0-ac7a-d75d730f8aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:19.005103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad835-8662-44e0-ac7a-d75d730f8aed admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:19.005378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad835-8662-44e0-ac7a-d75d730f8aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:19.005646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad835-8662-44e0-ac7a-d75d730f8aed admin admin] PATH_INFO: `/v3/users/e857abeb60bc4dc1a4e77460d99e20c2` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:19.006841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad835-8662-44e0-ac7a-d75d730f8aed admin admin] RBAC: Authorizing `identity:get_user(user_id=e857abeb60bc4dc1a4e77460d99e20c2)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:19.008942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad835-8662-44e0-ac7a-d75d730f8aed admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:19.010503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 570/1130] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:57:18 2021] GET /identity/v3/users/e857abeb60bc4dc1a4e77460d99e20c2 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:19.017357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:19.027047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf266ec-7a97-4e55-b8be-2a8a0e4afafc admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:19.031871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dd759-ff05-4d92-b7c1-a63346818472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:19.032725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dd759-ff05-4d92-b7c1-a63346818472 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:19.033002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dd759-ff05-4d92-b7c1-a63346818472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:19.033271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dd759-ff05-4d92-b7c1-a63346818472 admin admin] PATH_INFO: `/v3/projects/bad71aad432042d8a59a9569f81a090e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:19.034458 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dd759-ff05-4d92-b7c1-a63346818472 admin admin] RBAC: Authorizing `identity:get_project(project_id=bad71aad432042d8a59a9569f81a090e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:19.036549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dd759-ff05-4d92-b7c1-a63346818472 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:19.038222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 561/1131] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:57:19 2021] GET /identity/v3/projects/bad71aad432042d8a59a9569f81a090e => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:19.045307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad835-8662-44e0-ac7a-d75d730f8aed admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:19.055553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad835-8662-44e0-ac7a-d75d730f8aed admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:19.061140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f54b7-4aed-4680-9f9a-8598fe4d3df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:19.062677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f54b7-4aed-4680-9f9a-8598fe4d3df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:19.062959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f54b7-4aed-4680-9f9a-8598fe4d3df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:19.063232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f54b7-4aed-4680-9f9a-8598fe4d3df6 admin admin] PATH_INFO: `/v3/projects/bad71aad432042d8a59a9569f81a090e/users/e857abeb60bc4dc1a4e77460d99e20c2/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:19.065181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f54b7-4aed-4680-9f9a-8598fe4d3df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad71aad432042d8a59a9569f81a090e, user_id=e857abeb60bc4dc1a4e77460d99e20c2, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:19.067832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f54b7-4aed-4680-9f9a-8598fe4d3df6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:19.118294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 571/1132] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:57:19 2021] PUT /identity/v3/projects/bad71aad432042d8a59a9569f81a090e/users/e857abeb60bc4dc1a4e77460d99e20c2/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 16:57:21.386078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42f8e-5225-4638-a5ac-cdd38be80795 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:21.386729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42f8e-5225-4638-a5ac-cdd38be80795 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:21.386729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b42f8e-5225-4638-a5ac-cdd38be80795 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:21.388381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 562/1133] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:57:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:57:21.394838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33593-3dac-40e8-8a38-d5375cba9772 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:21.395218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33593-3dac-40e8-8a38-d5375cba9772 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:21.395384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33593-3dac-40e8-8a38-d5375cba9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:21.413070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-8ce33593-3dac-40e8-8a38-d5375cba9772 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:57:21.414159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8ce33593-3dac-40e8-8a38-d5375cba9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:57:21.471556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 572/1134] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:57:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:57:21.497291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b42f8e-5225-4638-a5ac-cdd38be80795 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:21.508960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b42f8e-5225-4638-a5ac-cdd38be80795 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:21.513140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b00674-b707-4a37-aece-93d14c873094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:21.513900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b00674-b707-4a37-aece-93d14c873094 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:21.514773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b00674-b707-4a37-aece-93d14c873094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:21.514969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b00674-b707-4a37-aece-93d14c873094 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:21.524613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b00674-b707-4a37-aece-93d14c873094 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:57:21.532113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-09b00674-b707-4a37-aece-93d14c873094 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:57:21.533252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 563/1135] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:57:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:57:21.539840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33593-3dac-40e8-8a38-d5375cba9772 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:21.548490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33593-3dac-40e8-8a38-d5375cba9772 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:21.552858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:21.553491 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:21.553767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:21.554033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:21.554801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:21.555121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:21.556757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:21.564702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 573/1136] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:57:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:21.571183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b00674-b707-4a37-aece-93d14c873094 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:21.581750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b00674-b707-4a37-aece-93d14c873094 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:21.586258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4036-a5dc-4d63-801e-d98857560266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:21.587120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4036-a5dc-4d63-801e-d98857560266 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:21.587401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4036-a5dc-4d63-801e-d98857560266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:21.587668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4036-a5dc-4d63-801e-d98857560266 admin admin] PATH_INFO: `/v3/users/e857abeb60bc4dc1a4e77460d99e20c2` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:21.588834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4036-a5dc-4d63-801e-d98857560266 admin admin] RBAC: Authorizing `identity:get_user(user_id=e857abeb60bc4dc1a4e77460d99e20c2)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:21.590967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4036-a5dc-4d63-801e-d98857560266 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:21.593122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 564/1137] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 16:57:21 2021] GET /identity/v3/users/e857abeb60bc4dc1a4e77460d99e20c2 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:21.600456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:21.609281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53736601-06ac-4bcb-a5db-72331c4d891c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:21.613996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb910b-62ee-4cf5-8ce8-ca37cd2d2b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:21.614648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb910b-62ee-4cf5-8ce8-ca37cd2d2b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:21.614924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb910b-62ee-4cf5-8ce8-ca37cd2d2b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:21.615191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb910b-62ee-4cf5-8ce8-ca37cd2d2b89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:21.622699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb910b-62ee-4cf5-8ce8-ca37cd2d2b89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:21.624918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb910b-62ee-4cf5-8ce8-ca37cd2d2b89 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:21.633389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 574/1138] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:57:21 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:57:21.639804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4036-a5dc-4d63-801e-d98857560266 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:21.649960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4036-a5dc-4d63-801e-d98857560266 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:21.654534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c470b-fb34-4985-a491-46b5d160a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:21.655432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c470b-fb34-4985-a491-46b5d160a9bd admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:21.655712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c470b-fb34-4985-a491-46b5d160a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:21.655986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c470b-fb34-4985-a491-46b5d160a9bd admin admin] PATH_INFO: `/v3/projects/bad71aad432042d8a59a9569f81a090e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:21.657150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c470b-fb34-4985-a491-46b5d160a9bd admin admin] RBAC: Authorizing `identity:get_project(project_id=bad71aad432042d8a59a9569f81a090e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:21.659214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c470b-fb34-4985-a491-46b5d160a9bd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:21.660822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 565/1139] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 16:57:21 2021] GET /identity/v3/projects/bad71aad432042d8a59a9569f81a090e => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:57:21.667224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb910b-62ee-4cf5-8ce8-ca37cd2d2b89 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:57:21.675627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb910b-62ee-4cf5-8ce8-ca37cd2d2b89 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:57:21.679997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70429f1-1a6c-46ba-ad20-a7e86a5e1b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:57:21.680606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70429f1-1a6c-46ba-ad20-a7e86a5e1b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:57:21.680879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70429f1-1a6c-46ba-ad20-a7e86a5e1b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:57:21.681143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70429f1-1a6c-46ba-ad20-a7e86a5e1b4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:57:21.681951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70429f1-1a6c-46ba-ad20-a7e86a5e1b4e admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=bad71aad432042d8a59a9569f81a090e, user.id=e857abeb60bc4dc1a4e77460d99e20c2) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:57:21.682253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70429f1-1a6c-46ba-ad20-a7e86a5e1b4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:57:21.684077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70429f1-1a6c-46ba-ad20-a7e86a5e1b4e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:57:21.690008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 575/1140] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:57:21 2021] GET /identity/v3/role_assignments?user.id=e857abeb60bc4dc1a4e77460d99e20c2&scope.project.id=bad71aad432042d8a59a9569f81a090e&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:37.012523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa727-3556-4af2-8192-ffd45ec854d8 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:37.013154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa727-3556-4af2-8192-ffd45ec854d8 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:37.013345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa727-3556-4af2-8192-ffd45ec854d8 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:37.016096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 566/1141] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:37.022169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6f8f-85d4-4dcc-b995-4a9aeb250bf3 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:37.022773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6f8f-85d4-4dcc-b995-4a9aeb250bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:37.022773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6f8f-85d4-4dcc-b995-4a9aeb250bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:37.042106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-255b6f8f-85d4-4dcc-b995-4a9aeb250bf3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:37.043321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-255b6f8f-85d4-4dcc-b995-4a9aeb250bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:37.054404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 576/1142] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:37.087768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fa727-3556-4af2-8192-ffd45ec854d8 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:37.099905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fa727-3556-4af2-8192-ffd45ec854d8 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:37.104983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:37.109191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:37.109191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:37.109191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:37.116346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:37.118800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:37.135290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:37.137390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 567/1143] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:37.143206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b6f8f-85d4-4dcc-b995-4a9aeb250bf3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:37.152365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b6f8f-85d4-4dcc-b995-4a9aeb250bf3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:37.157207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad70428-2e8d-4d2c-a887-1715a3bb72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:37.160389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70428-2e8d-4d2c-a887-1715a3bb72fb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:37.160389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70428-2e8d-4d2c-a887-1715a3bb72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:37.160389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70428-2e8d-4d2c-a887-1715a3bb72fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:37.160389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70428-2e8d-4d2c-a887-1715a3bb72fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:37.160389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70428-2e8d-4d2c-a887-1715a3bb72fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:37.161329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70428-2e8d-4d2c-a887-1715a3bb72fb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:37.173147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 577/1144] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:58:37.180214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:37.189814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c1252-7007-40c9-9461-c853aa3b73bb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:37.194507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6907fc-0d73-435d-a281-9a2f639a96bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:37.195220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6907fc-0d73-435d-a281-9a2f639a96bb admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:37.195501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6907fc-0d73-435d-a281-9a2f639a96bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:37.195831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6907fc-0d73-435d-a281-9a2f639a96bb admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:37.196543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6907fc-0d73-435d-a281-9a2f639a96bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:37.198466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6907fc-0d73-435d-a281-9a2f639a96bb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:37.303127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 568/1145] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Nov 11 16:58:37 2021] POST /identity/v3/users => generated 251 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:58:39.588826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037554bc-9e56-435f-9318-a9b2a57a0dd0 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.589366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037554bc-9e56-435f-9318-a9b2a57a0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.589366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037554bc-9e56-435f-9318-a9b2a57a0dd0 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.591154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 578/1146] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:39.596998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ff4c-bdcb-442e-bece-5aad951cafb4 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.602939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ff4c-bdcb-442e-bece-5aad951cafb4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.602939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ff4c-bdcb-442e-bece-5aad951cafb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.615805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1e21ff4c-bdcb-442e-bece-5aad951cafb4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:39.617482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1e21ff4c-bdcb-442e-bece-5aad951cafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:39.625481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 569/1147] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:39.651559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037554bc-9e56-435f-9318-a9b2a57a0dd0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:39.663549 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037554bc-9e56-435f-9318-a9b2a57a0dd0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:39.667932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbd8f4-7c7b-4013-b1d4-12dfc1630353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:39.668709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbd8f4-7c7b-4013-b1d4-12dfc1630353 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.668988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbd8f4-7c7b-4013-b1d4-12dfc1630353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.669260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbd8f4-7c7b-4013-b1d4-12dfc1630353 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.680185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbd8f4-7c7b-4013-b1d4-12dfc1630353 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:58:39.687195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-cffbd8f4-7c7b-4013-b1d4-12dfc1630353 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:58:39.688325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 579/1148] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:58:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:39.695483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21ff4c-bdcb-442e-bece-5aad951cafb4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:39.704440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21ff4c-bdcb-442e-bece-5aad951cafb4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:39.708906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:39.709553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.709827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.710094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.710890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:39.711194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:39.712774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:39.720742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 570/1149] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:58:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:39.727726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbd8f4-7c7b-4013-b1d4-12dfc1630353 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:39.737747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbd8f4-7c7b-4013-b1d4-12dfc1630353 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:39.742921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:39.746668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.746668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.746668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.754795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:39.756625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:39.775014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:39.776672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 580/1150] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:39.785976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:39.799540 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4d3cf-4fe4-4d53-a798-68f440dc1639 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:39.806797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:39.807862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.808329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.808785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.810082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:39.810715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:39.812340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:39.826939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 571/1151] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:39.836411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:39.846319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e46695-0d15-49b0-9521-c1729e05d44f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:39.850849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:39.851623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.851903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.852173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.859814 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:39.875632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:39.876547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:58:39.877678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 581/1152] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:39 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:39.885106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:39.894847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa38d0-1a41-4b12-8e68-8c69b577ce20 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:39.899345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:39.900052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.900331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.900601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.901434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:39.901736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:39.903695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:39.920302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 572/1153] 10.222.0.16 () {56 vars in 1164 bytes} [Thu Nov 11 16:58:39 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:39.926808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:39.936849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854edc6-6cb8-442a-9c0e-3f8f901795e6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:39.941339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d1df4-0c72-4fa8-8de4-2957e7a282e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:39.945498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d1df4-0c72-4fa8-8de4-2957e7a282e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.945498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d1df4-0c72-4fa8-8de4-2957e7a282e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.945498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d1df4-0c72-4fa8-8de4-2957e7a282e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.950767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d1df4-0c72-4fa8-8de4-2957e7a282e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:39.952541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d1df4-0c72-4fa8-8de4-2957e7a282e8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:39.961027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 582/1154] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:58:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:58:39.967678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:39.978119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271caea5-fda6-46f5-a2f0-cbcdb8601513 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:39.983109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:39.983989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:39.984288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:39.984597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:39.995857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:39.997764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:40.014074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:40.015256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 573/1155] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:40.021634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d1df4-0c72-4fa8-8de4-2957e7a282e8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:40.030379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d1df4-0c72-4fa8-8de4-2957e7a282e8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:40.034945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:40.035574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:40.035853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:40.036124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:40.036834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:40.037136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:40.039333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:40.050896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 583/1156] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:40.057544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:40.066803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528a1ad-301a-4baf-af3e-f54e712852d6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:40.071304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:40.077609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:40.077609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:40.077609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:40.079237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:40.081369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:40.094166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:58:40.095286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 574/1157] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:58:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:40.108338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:40.112252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cf708-b014-4a55-a325-61f1cb4390d0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:40.117823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a434594-061b-4c64-bb87-1906e7e67960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:40.118469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434594-061b-4c64-bb87-1906e7e67960 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:40.118783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434594-061b-4c64-bb87-1906e7e67960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:40.119058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434594-061b-4c64-bb87-1906e7e67960 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:40.119849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434594-061b-4c64-bb87-1906e7e67960 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:40.121840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434594-061b-4c64-bb87-1906e7e67960 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:40.121993 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434594-061b-4c64-bb87-1906e7e67960 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:40.134334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 584/1158] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:58:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:40.141005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:40.151117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a05d96-c0ba-4b6c-b51f-a579ead23c27 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:40.155592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d39c7-56da-434a-b592-b1b996744054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:40.156225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d39c7-56da-434a-b592-b1b996744054 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:40.156507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d39c7-56da-434a-b592-b1b996744054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:40.156781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d39c7-56da-434a-b592-b1b996744054 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:40.157617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d39c7-56da-434a-b592-b1b996744054 admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=db055fddc41c4eb0ba1c3b410e1e8e03) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:40.157927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d39c7-56da-434a-b592-b1b996744054 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:40.159874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d39c7-56da-434a-b592-b1b996744054 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:40.165962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 575/1159] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:58:40 2021] GET /identity/v3/role_assignments?user.id=db055fddc41c4eb0ba1c3b410e1e8e03&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:42.400371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f089-81f9-4e9c-9be9-5872c7cf2fe5 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.400880 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f089-81f9-4e9c-9be9-5872c7cf2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.400997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f089-81f9-4e9c-9be9-5872c7cf2fe5 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.402731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 585/1160] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:42.408611 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edbd39-044c-4a49-8a22-87f92a1920ec None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.409960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edbd39-044c-4a49-8a22-87f92a1920ec None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.409960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edbd39-044c-4a49-8a22-87f92a1920ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.425859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-86edbd39-044c-4a49-8a22-87f92a1920ec None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:42.427063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-86edbd39-044c-4a49-8a22-87f92a1920ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:42.435007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 576/1161] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:42.458654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090f089-81f9-4e9c-9be9-5872c7cf2fe5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.471250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090f089-81f9-4e9c-9be9-5872c7cf2fe5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.475626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65dfd-a6fd-4e1e-9af4-1a973b3a1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.476396 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65dfd-a6fd-4e1e-9af4-1a973b3a1708 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.476675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65dfd-a6fd-4e1e-9af4-1a973b3a1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.476946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65dfd-a6fd-4e1e-9af4-1a973b3a1708 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.487191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e65dfd-a6fd-4e1e-9af4-1a973b3a1708 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:58:42.494221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-b8e65dfd-a6fd-4e1e-9af4-1a973b3a1708 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:58:42.495375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 586/1162] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:58:42.503369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edbd39-044c-4a49-8a22-87f92a1920ec None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.512572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edbd39-044c-4a49-8a22-87f92a1920ec None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.517141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.517795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.518076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.518351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.519137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:42.524552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.524552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.529579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 577/1163] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:42.535868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65dfd-a6fd-4e1e-9af4-1a973b3a1708 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.545838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65dfd-a6fd-4e1e-9af4-1a973b3a1708 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.550253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.553266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.553266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.553266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.561750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.563642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.580772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:42.581928 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 587/1164] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:42.589209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.598724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f89c8-19c1-4faf-aa80-2062cee24a8d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.603208 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.604087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.604362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.604629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.605356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:42.605719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.607451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.619392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 578/1165] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:42.625591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.635920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed0016-46b4-4fc4-ac31-9e605d84d3c0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.640543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.641314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.641588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.641852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.649375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.651689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.665795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:58:42.666892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 588/1166] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:42.673235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.683290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dccbc0-d2e1-4a92-8c8c-192a25b17cf0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.687749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.688387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.688664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.688934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.689762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:42.690066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.692049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.709248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 579/1167] 10.222.0.16 () {56 vars in 1164 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:42.715496 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.725040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23ddf4-ce87-41e7-9e83-70f9c5f7a74f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.729800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.730602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.730888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.731159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.741093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.743464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.760663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:42.761805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 589/1168] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:42.768227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.777595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff4b5-aacc-4d6c-b4a1-47e744b8c7b7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.781988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.782769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.783046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.783312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.784072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:42.784365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.785920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.796910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 580/1169] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:42.803365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.813683 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8699d-07f0-42a2-9ea3-e9290caa3120 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.818245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.819058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.819951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.820228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.827067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.829004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.841788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:58:42.842953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 590/1170] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:42.849677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.859590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b211-e677-4efb-ae6b-0bbd6d1339e5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.864260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f95896-db2a-4e1b-b364-5f145fff416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.864885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f95896-db2a-4e1b-b364-5f145fff416a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.865179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f95896-db2a-4e1b-b364-5f145fff416a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.865448 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f95896-db2a-4e1b-b364-5f145fff416a admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.866822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f95896-db2a-4e1b-b364-5f145fff416a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:42.867131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f95896-db2a-4e1b-b364-5f145fff416a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.869145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f95896-db2a-4e1b-b364-5f145fff416a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:42.880889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 581/1171] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:58:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:42.888054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:42.898332 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09602a-122e-4f08-a350-9419d8c583f6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:42.902930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc9ae-d30d-4278-a4a9-fe52fb3d1c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:42.906525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc9ae-d30d-4278-a4a9-fe52fb3d1c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:42.906525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc9ae-d30d-4278-a4a9-fe52fb3d1c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:42.906525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc9ae-d30d-4278-a4a9-fe52fb3d1c62 admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/db055fddc41c4eb0ba1c3b410e1e8e03/roles/d9aae4994e18459dae9fd6b22e704d75` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:42.918442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bc9ae-d30d-4278-a4a9-fe52fb3d1c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=db055fddc41c4eb0ba1c3b410e1e8e03, role_id=d9aae4994e18459dae9fd6b22e704d75)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:42.921042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bc9ae-d30d-4278-a4a9-fe52fb3d1c62 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:43.080972 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 591/1172] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:58:42 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/db055fddc41c4eb0ba1c3b410e1e8e03/roles/d9aae4994e18459dae9fd6b22e704d75 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:58:45.338528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87adbf-0769-4738-aa61-5207ceb05865 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.339066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87adbf-0769-4738-aa61-5207ceb05865 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.339155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87adbf-0769-4738-aa61-5207ceb05865 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.340925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 582/1173] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:45.346698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9581-753a-424e-b36a-933cada90c85 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.347169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9581-753a-424e-b36a-933cada90c85 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.347277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9581-753a-424e-b36a-933cada90c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.364943 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c39a9581-753a-424e-b36a-933cada90c85 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:45.366160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c39a9581-753a-424e-b36a-933cada90c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:45.422907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 592/1174] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:45.448957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87adbf-0769-4738-aa61-5207ceb05865 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.462142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87adbf-0769-4738-aa61-5207ceb05865 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.466623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be979df5-96b0-4246-b53f-a8e0e0f5e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.467399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be979df5-96b0-4246-b53f-a8e0e0f5e2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.467704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be979df5-96b0-4246-b53f-a8e0e0f5e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.467978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be979df5-96b0-4246-b53f-a8e0e0f5e2a7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.477913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be979df5-96b0-4246-b53f-a8e0e0f5e2a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:58:45.485316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-be979df5-96b0-4246-b53f-a8e0e0f5e2a7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 11 16:58:45.490671 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 583/1175] 10.222.0.16 () {56 vars in 1123 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:45.493544 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a9581-753a-424e-b36a-933cada90c85 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.502402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a9581-753a-424e-b36a-933cada90c85 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.507448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.508103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.508390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.508658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.509412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:45.509723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.511398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.520961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 593/1176] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:45.528574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be979df5-96b0-4246-b53f-a8e0e0f5e2a7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.538921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be979df5-96b0-4246-b53f-a8e0e0f5e2a7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.544884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.545652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.547783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.547783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.556458 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.558312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.575389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:45.576542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 584/1177] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:45.583169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.593630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835deca4-450a-4891-86f7-0a26c2a1fdb9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.598142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.599120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.599120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.599368 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.604765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:45.604765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.604765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.613740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 594/1178] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:58:45.620669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.630214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a06407-2924-4946-8721-ee23d60ef974 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.639189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.639189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.639189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.639189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.644137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.646196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.659992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:58:45.661158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 585/1179] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:45.667800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.678926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370dc0a-607e-4af5-aaee-0eb967ff2360 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.683287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.683931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.684205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.684474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.685297 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:45.685596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.687449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.704579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 595/1180] 10.222.0.16 () {56 vars in 1164 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:45.711134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.720752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a7339-e7e6-499a-816e-80d9d3e3bd2d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.725400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7ba5-7b9a-4917-b5ca-c39e696b91d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.726029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7ba5-7b9a-4917-b5ca-c39e696b91d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.726311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7ba5-7b9a-4917-b5ca-c39e696b91d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.726649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7ba5-7b9a-4917-b5ca-c39e696b91d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.734568 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff7ba5-7b9a-4917-b5ca-c39e696b91d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.736323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff7ba5-7b9a-4917-b5ca-c39e696b91d7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.745689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 586/1181] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:58:45.754784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.764958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaed4e2-253a-4e2c-873e-3322764d74fe admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.769439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.771523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.771523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.771523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.781676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.783540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.799987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:45.801136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 596/1182] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:45.808256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7ba5-7b9a-4917-b5ca-c39e696b91d7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.816995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7ba5-7b9a-4917-b5ca-c39e696b91d7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.822140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.822802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.823078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.823384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.824101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:45.824397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.825960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.837029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 587/1183] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:45.844000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.852811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e4617-320b-4a0c-8c48-639cad56c4a3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.857841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.858658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.858938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.859264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.866713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.868830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.882341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:58:45.883503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 597/1184] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:45.889969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.899576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd8e20-6a72-4ac6-9d1d-a056c24b71d1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.904056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2d196-7f45-49eb-88c3-00c7de12a6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.904682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d196-7f45-49eb-88c3-00c7de12a6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.904962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d196-7f45-49eb-88c3-00c7de12a6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.905232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d196-7f45-49eb-88c3-00c7de12a6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.906150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d196-7f45-49eb-88c3-00c7de12a6e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:45.906452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d196-7f45-49eb-88c3-00c7de12a6e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.908286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d196-7f45-49eb-88c3-00c7de12a6e0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.920312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 588/1185] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:45.926847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:45.937771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84536a5e-cdd7-4a6c-8500-2604f1fa5f71 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:45.942289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0e59a-bb16-4297-b82f-41c6101f83ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:45.942939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0e59a-bb16-4297-b82f-41c6101f83ae admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:45.943217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0e59a-bb16-4297-b82f-41c6101f83ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:45.943488 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0e59a-bb16-4297-b82f-41c6101f83ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:45.944946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0e59a-bb16-4297-b82f-41c6101f83ae admin admin] RBAC: Adding query filter params (role.id=d9aae4994e18459dae9fd6b22e704d75, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=db055fddc41c4eb0ba1c3b410e1e8e03) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:45.945253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0e59a-bb16-4297-b82f-41c6101f83ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:45.947095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0e59a-bb16-4297-b82f-41c6101f83ae admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:45.952805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 598/1186] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:58:45 2021] GET /identity/v3/role_assignments?user.id=db055fddc41c4eb0ba1c3b410e1e8e03&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=d9aae4994e18459dae9fd6b22e704d75 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:48.293393 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d403e-2dd7-49ac-8ed7-98e61d1996cc None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.293922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d403e-2dd7-49ac-8ed7-98e61d1996cc None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.293922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d403e-2dd7-49ac-8ed7-98e61d1996cc None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.295770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 589/1187] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:48.301550 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e12a4-d8a6-4efe-a8a1-a953677312ff None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.306757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e12a4-d8a6-4efe-a8a1-a953677312ff None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.306757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e12a4-d8a6-4efe-a8a1-a953677312ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.319344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a38e12a4-d8a6-4efe-a8a1-a953677312ff None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:48.320518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a38e12a4-d8a6-4efe-a8a1-a953677312ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:48.327934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 599/1188] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:48.354754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d403e-2dd7-49ac-8ed7-98e61d1996cc None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.366784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d403e-2dd7-49ac-8ed7-98e61d1996cc None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.371036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecab83-2772-46a1-82cc-905939f6f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.371799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecab83-2772-46a1-82cc-905939f6f75b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.372071 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecab83-2772-46a1-82cc-905939f6f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.372340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecab83-2772-46a1-82cc-905939f6f75b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.382567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecab83-2772-46a1-82cc-905939f6f75b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:58:48.389424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c0ecab83-2772-46a1-82cc-905939f6f75b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:58:48.390592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 590/1189] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:48.397940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e12a4-d8a6-4efe-a8a1-a953677312ff None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.406754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e12a4-d8a6-4efe-a8a1-a953677312ff None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.411182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.411770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.412046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.412318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.413083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:48.413381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.415056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.423280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 600/1190] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:48.429625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecab83-2772-46a1-82cc-905939f6f75b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.440902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecab83-2772-46a1-82cc-905939f6f75b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.445831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.446615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.446895 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.447165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.456831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.458669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.475193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:48.476324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 591/1191] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:48.483826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.493378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca92f-b9ac-40a4-96dc-96beaac08c13 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.497803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.498437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.498743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.499011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.499725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:48.500127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.501657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.513869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 601/1192] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:48.521658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.531740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b608a9-88be-4c35-aa06-aec1b6e1dfa5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.536231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.537014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.537294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.537594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.544680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.546718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.560539 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:58:48.561689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 592/1193] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:48.568144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.578431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6971c5f-b756-4101-ba86-ba66cb91563a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.583038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.584934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.584934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.584934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.585661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:48.585966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.587827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.605020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 602/1194] 10.222.0.16 () {56 vars in 1164 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:48.611791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.622131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5d93-acf4-434a-b73c-33261a030166 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.626889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294f27-6f5a-4150-9d0f-060fd899b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.627544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294f27-6f5a-4150-9d0f-060fd899b215 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.627817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294f27-6f5a-4150-9d0f-060fd899b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.628102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294f27-6f5a-4150-9d0f-060fd899b215 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.636957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294f27-6f5a-4150-9d0f-060fd899b215 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.638707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294f27-6f5a-4150-9d0f-060fd899b215 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.647746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 593/1195] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:58:48.654368 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.665762 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a258134-3245-48a5-8120-21f41a26af0c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.668657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.669433 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.669715 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.669990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.682313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.684201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.701504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:48.702695 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 603/1196] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:48.709072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294f27-6f5a-4150-9d0f-060fd899b215 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.717810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294f27-6f5a-4150-9d0f-060fd899b215 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.722291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.722994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.723282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.723541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.724258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:48.724555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.726148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.737228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 594/1197] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:48.744617 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.754911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d77f5-31e2-4ee5-9a63-b54aa16562b4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.760114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.760891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.761172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.761446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.768255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.770188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.783062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:58:48.788214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 604/1198] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:48.790703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.800209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946339cb-0103-490b-8463-49daaf35338d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.805534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a26822-d609-41aa-b1cd-7c84852d864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.806166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26822-d609-41aa-b1cd-7c84852d864d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.806429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26822-d609-41aa-b1cd-7c84852d864d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.806728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26822-d609-41aa-b1cd-7c84852d864d admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.807508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a26822-d609-41aa-b1cd-7c84852d864d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:48.807808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a26822-d609-41aa-b1cd-7c84852d864d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.809613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a26822-d609-41aa-b1cd-7c84852d864d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.822619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 595/1199] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:48.829407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:48.839682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c4ab7-0afb-4bb8-87e5-1e4e09caf468 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:48.844156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caeaf6f-0012-4f94-8a24-abbf486e63a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:48.844780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeaf6f-0012-4f94-8a24-abbf486e63a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:48.845059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeaf6f-0012-4f94-8a24-abbf486e63a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:48.845337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeaf6f-0012-4f94-8a24-abbf486e63a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:48.846163 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caeaf6f-0012-4f94-8a24-abbf486e63a2 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=db055fddc41c4eb0ba1c3b410e1e8e03) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:48.846470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caeaf6f-0012-4f94-8a24-abbf486e63a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:48.848314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caeaf6f-0012-4f94-8a24-abbf486e63a2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:48.853713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 605/1200] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:58:48 2021] GET /identity/v3/role_assignments?user.id=db055fddc41c4eb0ba1c3b410e1e8e03&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:51.099543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e956174-3078-42b5-b849-77eb7b7851f4 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.100615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e956174-3078-42b5-b849-77eb7b7851f4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.100711 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e956174-3078-42b5-b849-77eb7b7851f4 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.102709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 596/1201] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:51.109062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f58bf-e697-4d9c-92a9-5bb9fb6fe3a7 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.109567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f58bf-e697-4d9c-92a9-5bb9fb6fe3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.109659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f58bf-e697-4d9c-92a9-5bb9fb6fe3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.127032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-798f58bf-e697-4d9c-92a9-5bb9fb6fe3a7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:51.128188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-798f58bf-e697-4d9c-92a9-5bb9fb6fe3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:51.135888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 606/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:51.160239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e956174-3078-42b5-b849-77eb7b7851f4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.173057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e956174-3078-42b5-b849-77eb7b7851f4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.177352 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cb178-accb-468e-870d-391e7dd68e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.178148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cb178-accb-468e-870d-391e7dd68e1d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.178425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cb178-accb-468e-870d-391e7dd68e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.178731 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cb178-accb-468e-870d-391e7dd68e1d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.188490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cb178-accb-468e-870d-391e7dd68e1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:58:51.195888 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-f97cb178-accb-468e-870d-391e7dd68e1d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:58:51.200220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 597/1203] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:51.205101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f58bf-e697-4d9c-92a9-5bb9fb6fe3a7 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.214557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f58bf-e697-4d9c-92a9-5bb9fb6fe3a7 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.219060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.223178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.223178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.223178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.223178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:51.223178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.223178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.231386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 607/1204] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:51.237810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cb178-accb-468e-870d-391e7dd68e1d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.248300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cb178-accb-468e-870d-391e7dd68e1d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.253014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.253822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.254101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.254383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.266044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.267968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.286365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:51.287812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 598/1205] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 11 16:58:51.294211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.304253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357ba6-0dbc-41e0-92a7-23f435e457e4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.309297 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.309997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.310272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.310537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.311301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:51.311671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.313319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.326383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 608/1206] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:51.333014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.344133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d8d85-5dee-4238-9151-e5c2f5c802eb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.348858 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.349705 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.349931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.350202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.358785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.360785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.375709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:58:51.376963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 599/1207] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:51.384279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.395159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a156e96-a1b2-4b45-9635-6803a37e3ca4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.400434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.401095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.401377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.401652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.402487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:51.402821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.404663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.421711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 609/1208] 10.222.0.16 () {56 vars in 1164 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:51.428904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.438739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43aaeb-bab8-417d-9f5a-9ebdddf4ff82 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.443730 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.444601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.444786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.445057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.455314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.457170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.474567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:51.475776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 600/1209] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:51.482514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.492148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04feab-a681-424b-86a3-6ae92376b1a1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.496647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.497285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.497562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.497829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.498574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:51.498879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.500489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.512809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 610/1210] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:51.519288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.529420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ec143-2127-407e-be49-2951f3887753 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.534114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.534948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.535228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.535500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.542574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.544519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.557380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:58:51.558552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 601/1211] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:51.565233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.576839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414250c-3b5d-45f3-b35c-5b8e45828305 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.581454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da783eb-bc0c-42df-960e-143fc8131477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.583694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da783eb-bc0c-42df-960e-143fc8131477 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.583694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da783eb-bc0c-42df-960e-143fc8131477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.583694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da783eb-bc0c-42df-960e-143fc8131477 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.583694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da783eb-bc0c-42df-960e-143fc8131477 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:51.583694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da783eb-bc0c-42df-960e-143fc8131477 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.586275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da783eb-bc0c-42df-960e-143fc8131477 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.606711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 611/1212] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:58:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:51.610559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:51.624134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fd9dc-f49d-4302-889d-5b1edd582c78 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:51.630723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3417d-1069-4bb0-a068-5c123a60b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:51.632354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3417d-1069-4bb0-a068-5c123a60b6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:51.632630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3417d-1069-4bb0-a068-5c123a60b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:51.632897 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3417d-1069-4bb0-a068-5c123a60b6b6 admin admin] PATH_INFO: `/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/db055fddc41c4eb0ba1c3b410e1e8e03/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:51.634937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3417d-1069-4bb0-a068-5c123a60b6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab3f75658c74a4abb8afd770e2087f5, user_id=db055fddc41c4eb0ba1c3b410e1e8e03, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:51.637607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3417d-1069-4bb0-a068-5c123a60b6b6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:51.715010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 602/1213] 10.222.0.16 () {58 vars in 1460 bytes} [Thu Nov 11 16:58:51 2021] PUT /identity/v3/projects/cab3f75658c74a4abb8afd770e2087f5/users/db055fddc41c4eb0ba1c3b410e1e8e03/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 16:58:54.052974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8d76-ae54-4d6e-bec9-1a89ad52117d None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.053614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8d76-ae54-4d6e-bec9-1a89ad52117d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.053614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8d76-ae54-4d6e-bec9-1a89ad52117d None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.055361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 612/1214] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:54.061537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385711-17f0-4f71-9a7f-b790d10f9cc7 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.061955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385711-17f0-4f71-9a7f-b790d10f9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.062083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385711-17f0-4f71-9a7f-b790d10f9cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.078981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e4385711-17f0-4f71-9a7f-b790d10f9cc7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:54.080172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e4385711-17f0-4f71-9a7f-b790d10f9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:54.137857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 603/1215] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:54.164509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db8d76-ae54-4d6e-bec9-1a89ad52117d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.177464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db8d76-ae54-4d6e-bec9-1a89ad52117d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.182072 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454bc7a-5d98-437e-bc47-2399e52f9a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.182925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454bc7a-5d98-437e-bc47-2399e52f9a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.183206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454bc7a-5d98-437e-bc47-2399e52f9a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.183476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454bc7a-5d98-437e-bc47-2399e52f9a78 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.194484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454bc7a-5d98-437e-bc47-2399e52f9a78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 11 16:58:54.201531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-7454bc7a-5d98-437e-bc47-2399e52f9a78 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 11 16:58:54.203075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 613/1216] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:54.210120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385711-17f0-4f71-9a7f-b790d10f9cc7 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.219170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385711-17f0-4f71-9a7f-b790d10f9cc7 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.223925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.224596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.224867 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.225134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.225971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:54.226270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.228157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.238514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 604/1217] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:54.245639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454bc7a-5d98-437e-bc47-2399e52f9a78 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.262041 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454bc7a-5d98-437e-bc47-2399e52f9a78 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.269148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.270420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.271845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.271978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.288714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.292026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.316927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:54.318597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 614/1218] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:54.325363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.336114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabfb7f-51c5-41f1-8fde-6c921cde42a2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.341783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.344157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.344157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.344157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.344157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:54.344157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.345647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.358105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 605/1219] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:58:54.365828 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.375892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26607bb8-c017-42b6-8354-b0d22fb2504f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.381019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.381806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.382084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.382350 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.390383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.392426 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.406597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 11 16:58:54.407765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 615/1220] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:54.414822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.424402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ae097-1f95-48e8-820f-23dbed236023 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.428878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.429519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.433774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.433774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.433774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:54.433774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.433774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.450021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 606/1221] 10.222.0.16 () {56 vars in 1164 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:58:54.456399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.466666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8fae5-c1ca-4854-ad38-120f7cc31043 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.471138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f047-75c5-46d3-8f6a-00a206434299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.471763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f047-75c5-46d3-8f6a-00a206434299 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.472049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f047-75c5-46d3-8f6a-00a206434299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.472321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f047-75c5-46d3-8f6a-00a206434299 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.483782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f047-75c5-46d3-8f6a-00a206434299 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.485529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f047-75c5-46d3-8f6a-00a206434299 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.494600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 616/1222] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 16:58:54.501313 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.511803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f2a7-d15f-4ad7-88b0-a6eed9affe8f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.516546 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.517319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.517596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.517866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.528505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.530379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.550237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 11 16:58:54.551482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 607/1223] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:54.558216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f047-75c5-46d3-8f6a-00a206434299 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.568477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f047-75c5-46d3-8f6a-00a206434299 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.573203 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.573862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.574137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.574407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.575170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:54.575472 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.577131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.589990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 617/1224] 10.222.0.16 () {56 vars in 1130 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 16:58:54.596463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.606524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845e3f-d203-400c-839a-2312bd777bc1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.611247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.612054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.612330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.612603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.620562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.622737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.636495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING keystone.server.flask.application [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 11 16:58:54.637695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 608/1225] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:54.644870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.654483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03275d-88cd-4aa9-8490-a7acd880259e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.659063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaf3ad-02bc-4844-94cc-b91223900d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.659700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaf3ad-02bc-4844-94cc-b91223900d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.659975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaf3ad-02bc-4844-94cc-b91223900d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.660243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaf3ad-02bc-4844-94cc-b91223900d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.661027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaf3ad-02bc-4844-94cc-b91223900d2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:54.661363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaf3ad-02bc-4844-94cc-b91223900d2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.663212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaf3ad-02bc-4844-94cc-b91223900d2d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.675055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 618/1226] 10.222.0.16 () {56 vars in 1169 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:54.682779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:54.694054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba959d-168a-4d5e-8e2a-415ac46eb9cb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:54.699128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d52756-403f-441e-a0f2-7668b550d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:54.699793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52756-403f-441e-a0f2-7668b550d9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:54.700846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52756-403f-441e-a0f2-7668b550d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:54.700846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52756-403f-441e-a0f2-7668b550d9e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:54.701215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d52756-403f-441e-a0f2-7668b550d9e8 admin admin] RBAC: Adding query filter params (role.id=b515f1065b7b4995a64817150cd03ce8, scope.project.id=cab3f75658c74a4abb8afd770e2087f5, user.id=db055fddc41c4eb0ba1c3b410e1e8e03) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:54.701522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d52756-403f-441e-a0f2-7668b550d9e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:54.703368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d52756-403f-441e-a0f2-7668b550d9e8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:54.709403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 609/1227] 10.222.0.16 () {56 vars in 1395 bytes} [Thu Nov 11 16:58:54 2021] GET /identity/v3/role_assignments?user.id=db055fddc41c4eb0ba1c3b410e1e8e03&scope.project.id=cab3f75658c74a4abb8afd770e2087f5&role.id=b515f1065b7b4995a64817150cd03ce8 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:57.032861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4876fc-680b-43e0-a448-46b6858c72fd None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:57.033401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4876fc-680b-43e0-a448-46b6858c72fd None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:57.033498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4876fc-680b-43e0-a448-46b6858c72fd None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:57.035207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 619/1228] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:57.041623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c9d88-5638-4725-a995-197c65f7daee None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:57.042061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c9d88-5638-4725-a995-197c65f7daee None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:57.042152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c9d88-5638-4725-a995-197c65f7daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:57.058813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-225c9d88-5638-4725-a995-197c65f7daee None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:57.059986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-225c9d88-5638-4725-a995-197c65f7daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:57.067546 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 610/1229] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:57.091098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4876fc-680b-43e0-a448-46b6858c72fd None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:57.103902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4876fc-680b-43e0-a448-46b6858c72fd None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:57.108215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:57.109005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:57.109271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:57.109545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:57.110193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:57.111799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:57.123170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 11 16:58:57.124293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 620/1230] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:58:57 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:58:57.132370 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c9d88-5638-4725-a995-197c65f7daee None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:57.141205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c9d88-5638-4725-a995-197c65f7daee None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:57.146216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c3463-a6d1-445f-af4d-6d5609fadcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:57.146920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3463-a6d1-445f-af4d-6d5609fadcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:57.147197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3463-a6d1-445f-af4d-6d5609fadcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:57.147470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c3463-a6d1-445f-af4d-6d5609fadcb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:57.148181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3463-a6d1-445f-af4d-6d5609fadcb4 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:57.148483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3463-a6d1-445f-af4d-6d5609fadcb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:57.150060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c3463-a6d1-445f-af4d-6d5609fadcb4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:57.156834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 611/1231] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Nov 11 16:58:57 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:57.161174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:57.171391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068c581-29f7-46d1-97ef-fda8387f7cc4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:57.175889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12660535-357e-4fe1-9f34-67cae578ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:57.176522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660535-357e-4fe1-9f34-67cae578ee23 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:57.176802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660535-357e-4fe1-9f34-67cae578ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:57.177074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660535-357e-4fe1-9f34-67cae578ee23 admin admin] PATH_INFO: `/v3/services` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:57.177773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12660535-357e-4fe1-9f34-67cae578ee23 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:58:57.178073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12660535-357e-4fe1-9f34-67cae578ee23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:57.179677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12660535-357e-4fe1-9f34-67cae578ee23 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:57.183919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 621/1232] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Nov 11 16:58:57 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:58:59.436707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4b47-ce9b-4204-beac-63ff39230633 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:59.437231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4b47-ce9b-4204-beac-63ff39230633 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:59.437231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4b47-ce9b-4204-beac-63ff39230633 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:59.438965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 612/1233] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:58:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:58:59.445366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06d75-4e2b-410c-a58d-0298fc8d018f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:59.445796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06d75-4e2b-410c-a58d-0298fc8d018f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:59.445918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06d75-4e2b-410c-a58d-0298fc8d018f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:59.464538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-62d06d75-4e2b-410c-a58d-0298fc8d018f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:58:59.465767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-62d06d75-4e2b-410c-a58d-0298fc8d018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:58:59.474085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 622/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:58:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:58:59.500016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4b47-ce9b-4204-beac-63ff39230633 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:58:59.511883 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4b47-ce9b-4204-beac-63ff39230633 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:58:59.516161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a935e-6613-4f58-b273-5913b9411121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:58:59.521333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a935e-6613-4f58-b273-5913b9411121 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:58:59.521333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a935e-6613-4f58-b273-5913b9411121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:58:59.521333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a935e-6613-4f58-b273-5913b9411121 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:58:59.521333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a935e-6613-4f58-b273-5913b9411121 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:58:59.521333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a935e-6613-4f58-b273-5913b9411121 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:58:59.604197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 613/1235] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Nov 11 16:58:59 2021] POST /identity/v3/services => generated 246 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 16:59:01.914739 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce579ea-e7a4-4cd0-ac9c-6e1855e230c5 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:01.915372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce579ea-e7a4-4cd0-ac9c-6e1855e230c5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:01.915372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce579ea-e7a4-4cd0-ac9c-6e1855e230c5 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:01.917013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 623/1236] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:59:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 16:59:01.922986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6d6d5-d8d4-4b08-9fac-3bb6e69c5177 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:01.923398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6d6d5-d8d4-4b08-9fac-3bb6e69c5177 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:01.923648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6d6d5-d8d4-4b08-9fac-3bb6e69c5177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:01.942205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5cb6d6d5-d8d4-4b08-9fac-3bb6e69c5177 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:59:01.943436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5cb6d6d5-d8d4-4b08-9fac-3bb6e69c5177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:59:01.960319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 614/1237] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:59:01 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:59:01.986740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce579ea-e7a4-4cd0-ac9c-6e1855e230c5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:59:01.999516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce579ea-e7a4-4cd0-ac9c-6e1855e230c5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:59:02.003794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:59:02.004597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:02.005056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:02.005338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:02.006173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:59:02.009160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:59:02.021648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 11 16:59:02.022855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 624/1238] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:59:01 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:59:02.029833 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6d6d5-d8d4-4b08-9fac-3bb6e69c5177 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:59:02.039445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6d6d5-d8d4-4b08-9fac-3bb6e69c5177 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:59:02.044001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:59:02.044641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:02.044916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:02.045185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:02.045890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:59:02.046191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:59:02.047800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:59:02.053558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 615/1239] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Nov 11 16:59:02 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:59:02.060000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:59:02.069658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee04fd-818e-4de8-a44a-73098cc79e1b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:59:02.074185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39fddd-5532-487e-8e69-04469e688a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:59:02.074853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39fddd-5532-487e-8e69-04469e688a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:02.075134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39fddd-5532-487e-8e69-04469e688a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:02.075407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39fddd-5532-487e-8e69-04469e688a4e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:02.076196 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39fddd-5532-487e-8e69-04469e688a4e admin admin] RBAC: Adding query filter params (interface=public, service_id=3ef3dd46222d434e856855a8ccd3a7f6, region_id=RegionOne) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:59:02.076502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39fddd-5532-487e-8e69-04469e688a4e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:59:02.078078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39fddd-5532-487e-8e69-04469e688a4e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:59:02.083708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 625/1240] 10.222.0.16 () {56 vars in 1272 bytes} [Thu Nov 11 16:59:02 2021] GET /identity/v3/endpoints?service_id=3ef3dd46222d434e856855a8ccd3a7f6&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:59:02.090305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:59:02.100861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af976bf3-92e2-4594-b9ae-e0e930253220 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:59:02.106013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3bf08-aed6-4312-a0c9-cb9eb4759064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:59:02.106722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bf08-aed6-4312-a0c9-cb9eb4759064 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:02.107005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bf08-aed6-4312-a0c9-cb9eb4759064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:02.107276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3bf08-aed6-4312-a0c9-cb9eb4759064 admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:02.107962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3bf08-aed6-4312-a0c9-cb9eb4759064 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:59:02.109623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3bf08-aed6-4312-a0c9-cb9eb4759064 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:59:02.116970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 616/1241] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 16:59:02 2021] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 16:59:04.417983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda413-9101-4f1a-a80e-5e4a688af722 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:04.418564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda413-9101-4f1a-a80e-5e4a688af722 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:04.418564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfda413-9101-4f1a-a80e-5e4a688af722 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:04.420722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 626/1242] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 16:59:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 16:59:04.426830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c972-cc7a-4b37-a29b-cf76f773e770 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:04.427261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c972-cc7a-4b37-a29b-cf76f773e770 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:04.427408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c972-cc7a-4b37-a29b-cf76f773e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:04.444395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-18c2c972-cc7a-4b37-a29b-cf76f773e770 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 16:59:04.445574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-18c2c972-cc7a-4b37-a29b-cf76f773e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 16:59:04.453596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 617/1243] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 16:59:04 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 16:59:04.479919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfda413-9101-4f1a-a80e-5e4a688af722 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:59:04.491708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfda413-9101-4f1a-a80e-5e4a688af722 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:59:04.495996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:59:04.496882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:04.497159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:04.497428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:04.498071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:59:04.499673 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:59:04.510419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING keystone.server.flask.application [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 11 16:59:04.511549 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 627/1244] 10.222.0.16 () {56 vars in 1138 bytes} [Thu Nov 11 16:59:04 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 11 16:59:04.518144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2c972-cc7a-4b37-a29b-cf76f773e770 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:59:04.527508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2c972-cc7a-4b37-a29b-cf76f773e770 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:59:04.532007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119aa70-231d-4e68-8a83-4473f890880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:59:04.532649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119aa70-231d-4e68-8a83-4473f890880f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:04.532928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119aa70-231d-4e68-8a83-4473f890880f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:04.533197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119aa70-231d-4e68-8a83-4473f890880f admin admin] PATH_INFO: `/v3/services` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:04.533901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119aa70-231d-4e68-8a83-4473f890880f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 16:59:04.534203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119aa70-231d-4e68-8a83-4473f890880f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:59:04.536445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119aa70-231d-4e68-8a83-4473f890880f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:59:04.541404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 618/1245] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Nov 11 16:59:04 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 16:59:04.547667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 16:59:04.557791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d40691-c60a-4280-a618-6eff48d9c1a8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 16:59:04.562236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63712a9c-0dd9-4fa2-a2c7-523e3d5cf792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 16:59:04.562886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712a9c-0dd9-4fa2-a2c7-523e3d5cf792 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 16:59:04.563171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712a9c-0dd9-4fa2-a2c7-523e3d5cf792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 16:59:04.563445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63712a9c-0dd9-4fa2-a2c7-523e3d5cf792 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 16:59:04.564180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63712a9c-0dd9-4fa2-a2c7-523e3d5cf792 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 16:59:04.565725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63712a9c-0dd9-4fa2-a2c7-523e3d5cf792 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 16:59:04.636456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 628/1246] 10.222.0.16 () {60 vars in 1165 bytes} [Thu Nov 11 16:59:04 2021] POST /identity/v3/endpoints => generated 331 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:05:34.116540 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3532f1-4671-4d8a-aa86-e55092c2ed61 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:34.117008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3532f1-4671-4d8a-aa86-e55092c2ed61 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:34.117515 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3532f1-4671-4d8a-aa86-e55092c2ed61 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:34.126765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 619/1247] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:05:34 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:05:34.128967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a4c9-b7a8-4c01-8915-bb38675cee0a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:34.129528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a4c9-b7a8-4c01-8915-bb38675cee0a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:34.130277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544a4c9-b7a8-4c01-8915-bb38675cee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:34.351899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2544a4c9-b7a8-4c01-8915-bb38675cee0a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:34.355022 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2544a4c9-b7a8-4c01-8915-bb38675cee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:34.560419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 629/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:05:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:05:34.565815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3532f1-4671-4d8a-aa86-e55092c2ed61 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:34.567816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4f3532f1-4671-4d8a-aa86-e55092c2ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:34.711794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3532f1-4671-4d8a-aa86-e55092c2ed61 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:34.814480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437706a-e67f-4892-ac2f-6010092c7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:34.815620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437706a-e67f-4892-ac2f-6010092c7636 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:34.816050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437706a-e67f-4892-ac2f-6010092c7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:34.816559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437706a-e67f-4892-ac2f-6010092c7636 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:34.818055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437706a-e67f-4892-ac2f-6010092c7636 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:34.820230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437706a-e67f-4892-ac2f-6010092c7636 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:34.843982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 620/1249] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 17:05:34 2021] GET /identity/v3/projects => generated 2553 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:05:37.373722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad892b-e6da-4929-a961-0e419195b138 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:37.374248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad892b-e6da-4929-a961-0e419195b138 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:37.374248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad892b-e6da-4929-a961-0e419195b138 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:37.376055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 630/1250] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:05:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:05:37.382719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f65cf0-17ad-4438-834b-b93d585c9e9d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:37.383160 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f65cf0-17ad-4438-834b-b93d585c9e9d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:37.383250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f65cf0-17ad-4438-834b-b93d585c9e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:37.477050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-77f65cf0-17ad-4438-834b-b93d585c9e9d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:37.478211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-77f65cf0-17ad-4438-834b-b93d585c9e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:37.583197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 621/1251] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:05:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:05:37.636527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761ca0-d408-413b-9a09-aa820b30f86f None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:37.636900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761ca0-d408-413b-9a09-aa820b30f86f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:37.637239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761ca0-d408-413b-9a09-aa820b30f86f None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:37.639223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 631/1252] 10.222.0.16 () {54 vars in 964 bytes} [Thu Nov 11 17:05:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:05:37.645637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2695-3213-4636-9768-322983c8db7e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:37.645922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2695-3213-4636-9768-322983c8db7e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:37.646196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2695-3213-4636-9768-322983c8db7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:37.724377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-511a2695-3213-4636-9768-322983c8db7e None None] MFA Rules not processed for user `872474833e2f49c9a9ceccef8914e2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:37.725564 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-511a2695-3213-4636-9768-322983c8db7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:37.798073 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 622/1253] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Nov 11 17:05:37 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:05:37.807854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4761ca0-d408-413b-9a09-aa820b30f86f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:37.809370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b4761ca0-d408-413b-9a09-aa820b30f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:37.909837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4761ca0-d408-413b-9a09-aa820b30f86f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:37.982948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605cb5b-447b-490b-9236-565c84ad4c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:37.983615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605cb5b-447b-490b-9236-565c84ad4c4f service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:37.983900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605cb5b-447b-490b-9236-565c84ad4c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:37.984174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605cb5b-447b-490b-9236-565c84ad4c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:37.986085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e605cb5b-447b-490b-9236-565c84ad4c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:38.092383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605cb5b-447b-490b-9236-565c84ad4c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:38.093818 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605cb5b-447b-490b-9236-565c84ad4c4f service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:38.111914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 632/1254] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:05:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:05:40.740460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d529-e0c1-41b7-904b-583892e80118 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:40.741027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d529-e0c1-41b7-904b-583892e80118 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:40.741027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d529-e0c1-41b7-904b-583892e80118 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:40.742780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 623/1255] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:05:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:05:40.748703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c678-c170-460e-a7dc-749c98b775ff None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:40.749139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c678-c170-460e-a7dc-749c98b775ff None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:40.749256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c678-c170-460e-a7dc-749c98b775ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:40.818097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ff41c678-c170-460e-a7dc-749c98b775ff None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:40.819337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ff41c678-c170-460e-a7dc-749c98b775ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:40.911586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 633/1256] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:05:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:05:40.953146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d529-e0c1-41b7-904b-583892e80118 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:40.954718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2d34d529-e0c1-41b7-904b-583892e80118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:41.057598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d529-e0c1-41b7-904b-583892e80118 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:41.130650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6ed7a-b65f-4bf7-bafe-0c1645a74d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:41.131291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6ed7a-b65f-4bf7-bafe-0c1645a74d06 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:41.131571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6ed7a-b65f-4bf7-bafe-0c1645a74d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:41.131838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6ed7a-b65f-4bf7-bafe-0c1645a74d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:41.133442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-afe6ed7a-b65f-4bf7-bafe-0c1645a74d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:41.237451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6ed7a-b65f-4bf7-bafe-0c1645a74d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:41.238811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6ed7a-b65f-4bf7-bafe-0c1645a74d06 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:41.257413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 624/1257] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:05:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:05:44.158097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbc61e-6f6d-49ef-9d92-a348165eaad3 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:44.159281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbc61e-6f6d-49ef-9d92-a348165eaad3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:44.159281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbc61e-6f6d-49ef-9d92-a348165eaad3 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:44.160579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 634/1258] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:05:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:05:44.167237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a40bd-599e-4063-ab11-ff44c8a27850 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:44.167737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a40bd-599e-4063-ab11-ff44c8a27850 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:44.167860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a40bd-599e-4063-ab11-ff44c8a27850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:44.237777 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-be2a40bd-599e-4063-ab11-ff44c8a27850 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:44.239613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-be2a40bd-599e-4063-ab11-ff44c8a27850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:44.335272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 625/1259] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:05:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:05:44.373871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbc61e-6f6d-49ef-9d92-a348165eaad3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:44.375482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-23dbc61e-6f6d-49ef-9d92-a348165eaad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:44.506509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbc61e-6f6d-49ef-9d92-a348165eaad3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:44.602068 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64ba50-4bff-475a-a47c-2d98ffb855d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:44.602961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64ba50-4bff-475a-a47c-2d98ffb855d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:44.603239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64ba50-4bff-475a-a47c-2d98ffb855d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:44.603512 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64ba50-4bff-475a-a47c-2d98ffb855d9 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:44.613808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64ba50-4bff-475a-a47c-2d98ffb855d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:44.615918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64ba50-4bff-475a-a47c-2d98ffb855d9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:44.617678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 635/1260] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:05:44 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:05:44.646746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddbfd-147e-4440-b9e5-f1bf9a7b6e2e None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:44.647085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddbfd-147e-4440-b9e5-f1bf9a7b6e2e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:44.647406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddbfd-147e-4440-b9e5-f1bf9a7b6e2e None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:44.649258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 626/1261] 10.222.0.16 () {54 vars in 964 bytes} [Thu Nov 11 17:05:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:05:44.656159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb366d-8183-422a-be3a-15933fefdbae None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:44.656486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb366d-8183-422a-be3a-15933fefdbae None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:44.656801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb366d-8183-422a-be3a-15933fefdbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:44.733320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-80bb366d-8183-422a-be3a-15933fefdbae None None] MFA Rules not processed for user `872474833e2f49c9a9ceccef8914e2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:44.734748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-80bb366d-8183-422a-be3a-15933fefdbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:44.811665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 636/1262] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Nov 11 17:05:44 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:05:44.821829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ddbfd-147e-4440-b9e5-f1bf9a7b6e2e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:44.823384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a99ddbfd-147e-4440-b9e5-f1bf9a7b6e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:44.934794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ddbfd-147e-4440-b9e5-f1bf9a7b6e2e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:45.015600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7112e35-413d-4aaf-be47-cf711cfbfe37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:45.016253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112e35-413d-4aaf-be47-cf711cfbfe37 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:45.016537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112e35-413d-4aaf-be47-cf711cfbfe37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:45.016812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112e35-413d-4aaf-be47-cf711cfbfe37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:45.018476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a7112e35-413d-4aaf-be47-cf711cfbfe37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:45.133467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7112e35-413d-4aaf-be47-cf711cfbfe37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:45.134945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7112e35-413d-4aaf-be47-cf711cfbfe37 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:45.153786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 627/1263] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:05:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:05:48.972102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63befbad-2635-4976-996d-c0be520adfa3 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:48.972650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63befbad-2635-4976-996d-c0be520adfa3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:48.972650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63befbad-2635-4976-996d-c0be520adfa3 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:48.975001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 637/1264] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:05:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:05:48.981669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7720c-0c93-43df-8f9e-c9f5f931245f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:48.982199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7720c-0c93-43df-8f9e-c9f5f931245f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:48.982199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7720c-0c93-43df-8f9e-c9f5f931245f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:49.052063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-dae7720c-0c93-43df-8f9e-c9f5f931245f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:49.053288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-dae7720c-0c93-43df-8f9e-c9f5f931245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:49.153613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 628/1265] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:05:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:05:49.190312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63befbad-2635-4976-996d-c0be520adfa3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:49.191900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-63befbad-2635-4976-996d-c0be520adfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:49.318124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63befbad-2635-4976-996d-c0be520adfa3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:49.409723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2723d-a9b1-4b3c-82ba-b32c5581e404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:49.410600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2723d-a9b1-4b3c-82ba-b32c5581e404 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:49.410881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2723d-a9b1-4b3c-82ba-b32c5581e404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:49.411355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2723d-a9b1-4b3c-82ba-b32c5581e404 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:49.425713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2723d-a9b1-4b3c-82ba-b32c5581e404 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:49.427869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2723d-a9b1-4b3c-82ba-b32c5581e404 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:49.429617 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 638/1266] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:05:49 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:05:49.443011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7720c-0c93-43df-8f9e-c9f5f931245f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:49.444205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-dae7720c-0c93-43df-8f9e-c9f5f931245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:49.530781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7720c-0c93-43df-8f9e-c9f5f931245f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:49.598485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319348b-cc01-45d0-b9be-738a0888970b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:49.599177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319348b-cc01-45d0-b9be-738a0888970b service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:49.599455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319348b-cc01-45d0-b9be-738a0888970b service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:49.599729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319348b-cc01-45d0-b9be-738a0888970b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:49.601477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1319348b-cc01-45d0-b9be-738a0888970b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:49.716159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319348b-cc01-45d0-b9be-738a0888970b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:49.717608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319348b-cc01-45d0-b9be-738a0888970b service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:49.736946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 629/1267] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:05:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:05:53.139778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef9ee-d5db-47d3-bc26-3aece0be326c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:53.140381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef9ee-d5db-47d3-bc26-3aece0be326c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:53.140381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ef9ee-d5db-47d3-bc26-3aece0be326c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:53.142219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 639/1268] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:05:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:05:53.149368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4226-c909-4952-9444-b6488b15ef19 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:53.150009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4226-c909-4952-9444-b6488b15ef19 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:53.150009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed4226-c909-4952-9444-b6488b15ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:53.232796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-98ed4226-c909-4952-9444-b6488b15ef19 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:53.234029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-98ed4226-c909-4952-9444-b6488b15ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:53.352969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 630/1269] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:05:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:05:53.399827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ef9ee-d5db-47d3-bc26-3aece0be326c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:53.401353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c88ef9ee-d5db-47d3-bc26-3aece0be326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:53.526407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ef9ee-d5db-47d3-bc26-3aece0be326c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:53.653171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d47b9d-91bd-4aa3-ad44-34988c52dd42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:53.654105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47b9d-91bd-4aa3-ad44-34988c52dd42 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:53.654572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47b9d-91bd-4aa3-ad44-34988c52dd42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:53.655035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47b9d-91bd-4aa3-ad44-34988c52dd42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:53.657866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e0d47b9d-91bd-4aa3-ad44-34988c52dd42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:53.831568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d47b9d-91bd-4aa3-ad44-34988c52dd42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:53.834376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d47b9d-91bd-4aa3-ad44-34988c52dd42 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:53.868828 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 640/1270] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:05:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:05:56.310615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96715b-0ba3-4ba8-9316-79138cfcadae None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:56.311209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96715b-0ba3-4ba8-9316-79138cfcadae None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:56.311209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96715b-0ba3-4ba8-9316-79138cfcadae None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:56.312922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 631/1271] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:05:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:05:56.320813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e210eb-f866-4967-a62c-26f6339406de None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:56.321347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e210eb-f866-4967-a62c-26f6339406de None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:56.321582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e210eb-f866-4967-a62c-26f6339406de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:56.405086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-28e210eb-f866-4967-a62c-26f6339406de None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:56.406516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-28e210eb-f866-4967-a62c-26f6339406de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:56.543159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 641/1272] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:05:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:05:56.584667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96715b-0ba3-4ba8-9316-79138cfcadae None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:05:56.586469 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9c96715b-0ba3-4ba8-9316-79138cfcadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:56.707986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96715b-0ba3-4ba8-9316-79138cfcadae None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:05:56.861282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e769ff2-7139-4f3a-9531-fcd8b6e2a68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:05:56.862499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769ff2-7139-4f3a-9531-fcd8b6e2a68d service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:56.863030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769ff2-7139-4f3a-9531-fcd8b6e2a68d service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:56.863517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e769ff2-7139-4f3a-9531-fcd8b6e2a68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:56.867477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6e769ff2-7139-4f3a-9531-fcd8b6e2a68d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:05:57.048349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e769ff2-7139-4f3a-9531-fcd8b6e2a68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:05:57.050168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e769ff2-7139-4f3a-9531-fcd8b6e2a68d service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:05:57.074182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 632/1273] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:05:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:05:59.762812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4012f2-fa5c-44ef-ae4d-e147f0ddba4b None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:59.763538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4012f2-fa5c-44ef-ae4d-e147f0ddba4b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:59.763801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4012f2-fa5c-44ef-ae4d-e147f0ddba4b None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:59.765731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 642/1274] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:05:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:05:59.773906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc70f-9150-45cf-83f8-1ece45d3728a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:05:59.774786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc70f-9150-45cf-83f8-1ece45d3728a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:05:59.775063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc70f-9150-45cf-83f8-1ece45d3728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:05:59.895093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b9fbc70f-9150-45cf-83f8-1ece45d3728a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:05:59.897943 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b9fbc70f-9150-45cf-83f8-1ece45d3728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:00.071534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 633/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:05:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:00.114622 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4012f2-fa5c-44ef-ae4d-e147f0ddba4b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:00.116674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-fc4012f2-fa5c-44ef-ae4d-e147f0ddba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:00.284862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4012f2-fa5c-44ef-ae4d-e147f0ddba4b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:00.396510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdfbd4-d2d0-4abc-97be-fdcb1974a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:00.397391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdfbd4-d2d0-4abc-97be-fdcb1974a9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:00.397667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdfbd4-d2d0-4abc-97be-fdcb1974a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:00.397941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdfbd4-d2d0-4abc-97be-fdcb1974a9b6 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:00.410799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdfbd4-d2d0-4abc-97be-fdcb1974a9b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:00.413613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdfbd4-d2d0-4abc-97be-fdcb1974a9b6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:00.415630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 643/1276] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:06:00 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:06:00.433747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbc70f-9150-45cf-83f8-1ece45d3728a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:00.435183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b9fbc70f-9150-45cf-83f8-1ece45d3728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:00.554291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbc70f-9150-45cf-83f8-1ece45d3728a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:00.659875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7ced2-1026-45c1-8688-7e0ff81f9c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:00.660611 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7ced2-1026-45c1-8688-7e0ff81f9c5e service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:00.661040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7ced2-1026-45c1-8688-7e0ff81f9c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:00.661502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7ced2-1026-45c1-8688-7e0ff81f9c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:00.664366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9ba7ced2-1026-45c1-8688-7e0ff81f9c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:00.836125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7ced2-1026-45c1-8688-7e0ff81f9c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:00.840444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7ced2-1026-45c1-8688-7e0ff81f9c5e service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:00.866746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 634/1277] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:03.741570 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb9475-6a43-47e4-9537-10688347e53d None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:03.742230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb9475-6a43-47e4-9537-10688347e53d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:03.742230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb9475-6a43-47e4-9537-10688347e53d None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:03.743898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 644/1278] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:06:03.750762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272394d2-fdc4-47e7-902f-8acec857d88c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:03.751306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272394d2-fdc4-47e7-902f-8acec857d88c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:03.751306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272394d2-fdc4-47e7-902f-8acec857d88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:03.821345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-272394d2-fdc4-47e7-902f-8acec857d88c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:03.822607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-272394d2-fdc4-47e7-902f-8acec857d88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:03.923418 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 635/1279] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:06:03.964058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb9475-6a43-47e4-9537-10688347e53d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:03.965773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7acb9475-6a43-47e4-9537-10688347e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:04.133590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb9475-6a43-47e4-9537-10688347e53d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:04.267598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe47574-a109-416a-9a0d-67e86c4a813f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:04.268670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47574-a109-416a-9a0d-67e86c4a813f service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:04.269148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47574-a109-416a-9a0d-67e86c4a813f service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:04.269632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47574-a109-416a-9a0d-67e86c4a813f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:04.273748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bbe47574-a109-416a-9a0d-67e86c4a813f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:04.400112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe47574-a109-416a-9a0d-67e86c4a813f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:04.401463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe47574-a109-416a-9a0d-67e86c4a813f service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:04.420536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 645/1280] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:06:06.892796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33cadd-6d94-41b9-80c2-4d720fd16640 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:06.893374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33cadd-6d94-41b9-80c2-4d720fd16640 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:06.893998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33cadd-6d94-41b9-80c2-4d720fd16640 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:06.898122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 636/1281] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:06 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:06.907553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b709-e645-401f-ac63-e4789c1fc95f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:06.908397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b709-e645-401f-ac63-e4789c1fc95f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:06.908397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b709-e645-401f-ac63-e4789c1fc95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:06.960115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-5ef4b709-e645-401f-ac63-e4789c1fc95f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:06.962080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5ef4b709-e645-401f-ac63-e4789c1fc95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:06.993044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 646/1282] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:07.043396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33cadd-6d94-41b9-80c2-4d720fd16640 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:07.045994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-cd33cadd-6d94-41b9-80c2-4d720fd16640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:07.141383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33cadd-6d94-41b9-80c2-4d720fd16640 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:07.146532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542f307-556c-45bf-ad7f-ec7a87e729ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:07.147253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f307-556c-45bf-ad7f-ec7a87e729ae service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:07.147543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f307-556c-45bf-ad7f-ec7a87e729ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:07.147812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f307-556c-45bf-ad7f-ec7a87e729ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:07.158118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542f307-556c-45bf-ad7f-ec7a87e729ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:07.159635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542f307-556c-45bf-ad7f-ec7a87e729ae service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:07.171286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 637/1283] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:10.132987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3c3e-2630-4c3c-a0de-7cbf5de49d55 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:10.133575 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3c3e-2630-4c3c-a0de-7cbf5de49d55 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:10.133881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3c3e-2630-4c3c-a0de-7cbf5de49d55 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:10.137123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 647/1284] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:10.146737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87b0a-c0cd-48ef-bd8d-e61fe5e172a3 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:10.147596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87b0a-c0cd-48ef-bd8d-e61fe5e172a3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:10.147798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87b0a-c0cd-48ef-bd8d-e61fe5e172a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:10.172058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-81f87b0a-c0cd-48ef-bd8d-e61fe5e172a3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:10.173291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-81f87b0a-c0cd-48ef-bd8d-e61fe5e172a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:10.182409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 638/1285] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:10.221185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c3c3e-2630-4c3c-a0de-7cbf5de49d55 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:10.233060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c3c3e-2630-4c3c-a0de-7cbf5de49d55 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:10.237225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd4904-23fa-4795-82a7-9ae91af05f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:10.237884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd4904-23fa-4795-82a7-9ae91af05f87 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:10.238167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd4904-23fa-4795-82a7-9ae91af05f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:10.238439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd4904-23fa-4795-82a7-9ae91af05f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:10.248969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd4904-23fa-4795-82a7-9ae91af05f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:10.250428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd4904-23fa-4795-82a7-9ae91af05f87 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:10.261160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 648/1286] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:15.312065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2e2c-674b-4e48-b9a1-d90ba63ac5e4 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:15.312944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2e2c-674b-4e48-b9a1-d90ba63ac5e4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:15.312944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2e2c-674b-4e48-b9a1-d90ba63ac5e4 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:15.314487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 639/1287] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:15.321711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cc8d8-1af4-43b7-8604-065111bd8d44 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:15.322265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cc8d8-1af4-43b7-8604-065111bd8d44 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:15.322265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cc8d8-1af4-43b7-8604-065111bd8d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:15.343352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-225cc8d8-1af4-43b7-8604-065111bd8d44 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:15.344948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-225cc8d8-1af4-43b7-8604-065111bd8d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:15.354503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 649/1288] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:06:15.397534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf2e2c-674b-4e48-b9a1-d90ba63ac5e4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:15.410989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf2e2c-674b-4e48-b9a1-d90ba63ac5e4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:15.415181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd4c9-5a6d-4648-a558-7565d94eaca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:15.415897 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd4c9-5a6d-4648-a558-7565d94eaca7 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:15.416250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd4c9-5a6d-4648-a558-7565d94eaca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:15.416583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd4c9-5a6d-4648-a558-7565d94eaca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:15.426233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cd4c9-5a6d-4648-a558-7565d94eaca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:15.427669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cd4c9-5a6d-4648-a558-7565d94eaca7 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:15.438961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 640/1289] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:19.209438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40da33-2378-4d38-9e74-965346da1bd3 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:19.210235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40da33-2378-4d38-9e74-965346da1bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:19.210416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40da33-2378-4d38-9e74-965346da1bd3 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:19.213644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 650/1290] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:19 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:19.223561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c851-d73c-46f8-a66c-7f21ba9f3343 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:19.224901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c851-d73c-46f8-a66c-7f21ba9f3343 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:19.225079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c851-d73c-46f8-a66c-7f21ba9f3343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:19.247403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c9f1c851-d73c-46f8-a66c-7f21ba9f3343 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:19.248643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c9f1c851-d73c-46f8-a66c-7f21ba9f3343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:19.259650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 641/1291] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:19.304022 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40da33-2378-4d38-9e74-965346da1bd3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:19.317470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40da33-2378-4d38-9e74-965346da1bd3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:19.321541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5ec8b-65e4-4391-8a58-3acd819b3e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:19.322276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5ec8b-65e4-4391-8a58-3acd819b3e7f service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:19.322654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5ec8b-65e4-4391-8a58-3acd819b3e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:19.323087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5ec8b-65e4-4391-8a58-3acd819b3e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:19.334081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5ec8b-65e4-4391-8a58-3acd819b3e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:19.335655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5ec8b-65e4-4391-8a58-3acd819b3e7f service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:19.346664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 651/1292] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:06:25.087508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d644fb-adc2-48cb-8207-2db7ef8e041f None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:25.088315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d644fb-adc2-48cb-8207-2db7ef8e041f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:25.088315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d644fb-adc2-48cb-8207-2db7ef8e041f None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:25.089868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 642/1293] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:06:25.097434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af77c-8468-4a25-b8ae-578363044ba9 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:25.100405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af77c-8468-4a25-b8ae-578363044ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:25.100405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af77c-8468-4a25-b8ae-578363044ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:25.119696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-d54af77c-8468-4a25-b8ae-578363044ba9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:25.121005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d54af77c-8468-4a25-b8ae-578363044ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:25.134595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 652/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:25.185855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d644fb-adc2-48cb-8207-2db7ef8e041f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:25.188119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-38d644fb-adc2-48cb-8207-2db7ef8e041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:25.204342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d644fb-adc2-48cb-8207-2db7ef8e041f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:25.207961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7587104-7fc0-47c3-b07f-575ecae71a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:25.209253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7587104-7fc0-47c3-b07f-575ecae71a16 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:25.209531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7587104-7fc0-47c3-b07f-575ecae71a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:25.209807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7587104-7fc0-47c3-b07f-575ecae71a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:25.221373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7587104-7fc0-47c3-b07f-575ecae71a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:25.226595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7587104-7fc0-47c3-b07f-575ecae71a16 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:25.233791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 643/1295] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:30.698282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485288bb-4988-4b47-bed2-659d323abd87 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:30.699183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485288bb-4988-4b47-bed2-659d323abd87 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:30.699605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485288bb-4988-4b47-bed2-659d323abd87 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:30.701605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 653/1296] 10.222.0.16 () {54 vars in 921 bytes} [Thu Nov 11 17:06:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:30.707597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58073-dccc-4554-ace0-e64e9454d4a0 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:30.708114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58073-dccc-4554-ace0-e64e9454d4a0 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:30.708114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58073-dccc-4554-ace0-e64e9454d4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:30.815032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-bcf58073-dccc-4554-ace0-e64e9454d4a0 None None] MFA Rules not processed for user `db055fddc41c4eb0ba1c3b410e1e8e03`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:30.816899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bcf58073-dccc-4554-ace0-e64e9454d4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:30.931426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 644/1297] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Nov 11 17:06:30 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:06:36.758868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455d703-239d-40cc-8172-a7f1421bd6ed None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:36.760011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455d703-239d-40cc-8172-a7f1421bd6ed None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:36.760446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455d703-239d-40cc-8172-a7f1421bd6ed None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:36.763614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 654/1298] 10.222.0.16 () {54 vars in 921 bytes} [Thu Nov 11 17:06:36 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:06:36.770681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8613-737b-434a-9672-3bb4b272ab2c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:36.772375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8613-737b-434a-9672-3bb4b272ab2c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:36.772820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e8613-737b-434a-9672-3bb4b272ab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:36.794481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-677e8613-737b-434a-9672-3bb4b272ab2c None None] MFA Rules not processed for user `db055fddc41c4eb0ba1c3b410e1e8e03`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:36.796309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-677e8613-737b-434a-9672-3bb4b272ab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:36.808771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 645/1299] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Nov 11 17:06:36 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:06:38.793529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016cf4f-ef67-43a2-9e00-53342e1c8085 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:38.794348 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016cf4f-ef67-43a2-9e00-53342e1c8085 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:38.794572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016cf4f-ef67-43a2-9e00-53342e1c8085 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:38.796574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 655/1300] 10.222.0.16 () {54 vars in 921 bytes} [Thu Nov 11 17:06:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:38.805337 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55686c-1c5f-464e-b63a-f35278c3e686 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:38.806170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55686c-1c5f-464e-b63a-f35278c3e686 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:38.806533 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55686c-1c5f-464e-b63a-f35278c3e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:38.830032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6e55686c-1c5f-464e-b63a-f35278c3e686 None None] MFA Rules not processed for user `db055fddc41c4eb0ba1c3b410e1e8e03`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:38.832260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6e55686c-1c5f-464e-b63a-f35278c3e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:38.848037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 646/1301] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Nov 11 17:06:38 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:43.585291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306961d-cc9e-4886-9078-3e6dbdf41d37 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:43.586171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306961d-cc9e-4886-9078-3e6dbdf41d37 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:43.586631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306961d-cc9e-4886-9078-3e6dbdf41d37 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:43.590026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 656/1302] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:43 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:43.601712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d18ea-227a-414c-ad3b-b5bb364e8d23 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:43.602508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d18ea-227a-414c-ad3b-b5bb364e8d23 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:43.602874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d18ea-227a-414c-ad3b-b5bb364e8d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:43.633589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e96d18ea-227a-414c-ad3b-b5bb364e8d23 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:43.635462 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e96d18ea-227a-414c-ad3b-b5bb364e8d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:43.649506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 647/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:43.743689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48944-42a7-42b0-8383-4f9509af482e None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:43.744493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48944-42a7-42b0-8383-4f9509af482e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:43.745276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48944-42a7-42b0-8383-4f9509af482e None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:43.749454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 657/1304] 10.222.0.16 () {54 vars in 961 bytes} [Thu Nov 11 17:06:43 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:43.760333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc9d56-91cc-4e8c-9d28-2cfe479b8f21 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:43.760844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc9d56-91cc-4e8c-9d28-2cfe479b8f21 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:43.761333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc9d56-91cc-4e8c-9d28-2cfe479b8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:43.857560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-afcc9d56-91cc-4e8c-9d28-2cfe479b8f21 None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:43.859197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-afcc9d56-91cc-4e8c-9d28-2cfe479b8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:44.020499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 648/1305] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Nov 11 17:06:43 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:44.038192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c48944-42a7-42b0-8383-4f9509af482e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:44.066947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c48944-42a7-42b0-8383-4f9509af482e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:44.076835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434833-f5a1-4822-b9d1-c87aceaea47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:44.077797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434833-f5a1-4822-b9d1-c87aceaea47f service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:44.078235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434833-f5a1-4822-b9d1-c87aceaea47f service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:44.078718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434833-f5a1-4822-b9d1-c87aceaea47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:44.093469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434833-f5a1-4822-b9d1-c87aceaea47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:44.096247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61434833-f5a1-4822-b9d1-c87aceaea47f service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:44.118907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 658/1306] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:47.292439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cca79-7420-4e6a-8313-3d7470c2b7f0 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:47.292948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cca79-7420-4e6a-8313-3d7470c2b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:47.293355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cca79-7420-4e6a-8313-3d7470c2b7f0 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:47.294812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 649/1307] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:47.301533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6252-7454-4dbd-9f78-c9d242ffe6e7 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:47.302469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6252-7454-4dbd-9f78-c9d242ffe6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:47.302752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f6252-7454-4dbd-9f78-c9d242ffe6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:47.324008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b46f6252-7454-4dbd-9f78-c9d242ffe6e7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:47.326297 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b46f6252-7454-4dbd-9f78-c9d242ffe6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:47.339213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 659/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:47.387545 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cca79-7420-4e6a-8313-3d7470c2b7f0 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:47.405348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cca79-7420-4e6a-8313-3d7470c2b7f0 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:47.412076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aee7d5-e467-41fa-93ad-29c5b28cad08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:47.412918 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee7d5-e467-41fa-93ad-29c5b28cad08 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:47.413146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee7d5-e467-41fa-93ad-29c5b28cad08 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:47.413528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee7d5-e467-41fa-93ad-29c5b28cad08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:47.423946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee7d5-e467-41fa-93ad-29c5b28cad08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:47.425904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee7d5-e467-41fa-93ad-29c5b28cad08 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:47.437550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 650/1309] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:51.690734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebaefd-913e-4591-94b7-78c79edccb3c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:51.691578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebaefd-913e-4591-94b7-78c79edccb3c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:51.691916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebaefd-913e-4591-94b7-78c79edccb3c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:51.694654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 660/1310] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:51.702417 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426e91-164c-46a2-97fb-9de6f92f4a89 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:51.703285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426e91-164c-46a2-97fb-9de6f92f4a89 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:51.703598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426e91-164c-46a2-97fb-9de6f92f4a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:51.726138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ea426e91-164c-46a2-97fb-9de6f92f4a89 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:51.727648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ea426e91-164c-46a2-97fb-9de6f92f4a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:51.736600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 651/1311] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:06:51.835800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a314b-e271-4500-808b-2af8adc76854 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:51.836113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a314b-e271-4500-808b-2af8adc76854 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:51.836435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a314b-e271-4500-808b-2af8adc76854 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:51.838374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 661/1312] 10.222.0.16 () {54 vars in 961 bytes} [Thu Nov 11 17:06:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:06:51.848308 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6215ea-c1fa-478d-a6a9-dc37b0d9c7a8 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:51.849536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6215ea-c1fa-478d-a6a9-dc37b0d9c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:51.849800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6215ea-c1fa-478d-a6a9-dc37b0d9c7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:51.871400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3b6215ea-c1fa-478d-a6a9-dc37b0d9c7a8 None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:51.872613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3b6215ea-c1fa-478d-a6a9-dc37b0d9c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:51.885884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 652/1313] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Nov 11 17:06:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:51.902445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a314b-e271-4500-808b-2af8adc76854 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:51.929404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a314b-e271-4500-808b-2af8adc76854 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:51.941258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee4710-0550-4875-9147-e566591ceb31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:51.942140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4710-0550-4875-9147-e566591ceb31 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:51.942469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4710-0550-4875-9147-e566591ceb31 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:51.943307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee4710-0550-4875-9147-e566591ceb31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:51.954209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee4710-0550-4875-9147-e566591ceb31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:51.956107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee4710-0550-4875-9147-e566591ceb31 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:51.969507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 662/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:52.648339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ced45-13cf-43c7-9b3e-cd60135ecc71 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:52.648770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ced45-13cf-43c7-9b3e-cd60135ecc71 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:52.648879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ced45-13cf-43c7-9b3e-cd60135ecc71 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:52.650988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 653/1315] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:52.657556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3849d-776b-492d-8973-09a1cce2104a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:52.657843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3849d-776b-492d-8973-09a1cce2104a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:52.658308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3849d-776b-492d-8973-09a1cce2104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:52.677589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c8d3849d-776b-492d-8973-09a1cce2104a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:52.678851 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c8d3849d-776b-492d-8973-09a1cce2104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:52.687018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 663/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:52.750982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94990d9a-5bb5-48ff-839e-fd3e0c3c2821 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:52.751877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94990d9a-5bb5-48ff-839e-fd3e0c3c2821 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:52.752326 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94990d9a-5bb5-48ff-839e-fd3e0c3c2821 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:52.754113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 654/1317] 10.222.0.16 () {54 vars in 962 bytes} [Thu Nov 11 17:06:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:52.760014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fbba1-4af6-47f4-ad61-9551a0faa88d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:52.760555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fbba1-4af6-47f4-ad61-9551a0faa88d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:52.760555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fbba1-4af6-47f4-ad61-9551a0faa88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:52.814702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2e5fbba1-4af6-47f4-ad61-9551a0faa88d None None] MFA Rules not processed for user `b88bc12e78894bdbaf79d148c3dd2e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:52.815939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2e5fbba1-4af6-47f4-ad61-9551a0faa88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:52.882619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 664/1318] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Nov 11 17:06:52 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:52.890638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94990d9a-5bb5-48ff-839e-fd3e0c3c2821 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:52.902683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94990d9a-5bb5-48ff-839e-fd3e0c3c2821 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:52.906992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef38781-caf6-4ff8-9562-d24a69f264bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:52.907889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38781-caf6-4ff8-9562-d24a69f264bd service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:52.908251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38781-caf6-4ff8-9562-d24a69f264bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:52.908585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38781-caf6-4ff8-9562-d24a69f264bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:52.918725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef38781-caf6-4ff8-9562-d24a69f264bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:52.920251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef38781-caf6-4ff8-9562-d24a69f264bd service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:52.930139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 655/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:55.779743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9867dc-096f-4df2-9ccf-5ff1b2191ed5 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:55.780852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9867dc-096f-4df2-9ccf-5ff1b2191ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:55.781199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9867dc-096f-4df2-9ccf-5ff1b2191ed5 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:55.783142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 665/1320] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:55 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:55.790087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2b06-f1ff-41b5-9609-22f2bdb63d2c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:55.791126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2b06-f1ff-41b5-9609-22f2bdb63d2c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:55.791126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2b06-f1ff-41b5-9609-22f2bdb63d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:55.842493 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-696a2b06-f1ff-41b5-9609-22f2bdb63d2c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:55.850576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-696a2b06-f1ff-41b5-9609-22f2bdb63d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:55.858997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 656/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:06:55.914903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9867dc-096f-4df2-9ccf-5ff1b2191ed5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:55.939587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9867dc-096f-4df2-9ccf-5ff1b2191ed5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:55.949525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ca423-df75-4600-958d-1b7a4b773568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:55.950659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca423-df75-4600-958d-1b7a4b773568 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:55.951145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca423-df75-4600-958d-1b7a4b773568 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:55.951624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca423-df75-4600-958d-1b7a4b773568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:55.968123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ca423-df75-4600-958d-1b7a4b773568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:55.971329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ca423-df75-4600-958d-1b7a4b773568 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:56.005104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 666/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:06:59.229646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300d8ea-bd14-4a29-9ed0-900e67e1b0b1 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:59.230537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300d8ea-bd14-4a29-9ed0-900e67e1b0b1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:59.230537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300d8ea-bd14-4a29-9ed0-900e67e1b0b1 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:59.233966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 657/1323] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:06:59 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:06:59.243124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f8e2-5a25-430d-b9dd-f532c0149e16 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:59.244235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f8e2-5a25-430d-b9dd-f532c0149e16 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:59.244809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f8e2-5a25-430d-b9dd-f532c0149e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:59.266285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-8f31f8e2-5a25-430d-b9dd-f532c0149e16 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:06:59.267812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8f31f8e2-5a25-430d-b9dd-f532c0149e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:06:59.277998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 667/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:06:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:06:59.341426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300d8ea-bd14-4a29-9ed0-900e67e1b0b1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:06:59.365410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300d8ea-bd14-4a29-9ed0-900e67e1b0b1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:06:59.372455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05d1c9-f829-43da-aa91-f6bbfe3f4ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:06:59.373444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d1c9-f829-43da-aa91-f6bbfe3f4ec5 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:06:59.373994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d1c9-f829-43da-aa91-f6bbfe3f4ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:06:59.374593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05d1c9-f829-43da-aa91-f6bbfe3f4ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:06:59.385523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05d1c9-f829-43da-aa91-f6bbfe3f4ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:06:59.387562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05d1c9-f829-43da-aa91-f6bbfe3f4ec5 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:06:59.400332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 658/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:06:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:07:02.824189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc1fe-5d8d-4d62-a68e-bb7f20a86bc5 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:02.824735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc1fe-5d8d-4d62-a68e-bb7f20a86bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:02.824836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc1fe-5d8d-4d62-a68e-bb7f20a86bc5 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:02.827652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 668/1326] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:02.834892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8691dd-aa06-4e6a-8637-0019d4e70d68 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:02.835647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8691dd-aa06-4e6a-8637-0019d4e70d68 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:02.835647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8691dd-aa06-4e6a-8637-0019d4e70d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:02.857580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9d8691dd-aa06-4e6a-8637-0019d4e70d68 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:02.858820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9d8691dd-aa06-4e6a-8637-0019d4e70d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:02.867947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 659/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:07:02.944999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cc1fe-5d8d-4d62-a68e-bb7f20a86bc5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:02.966576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cc1fe-5d8d-4d62-a68e-bb7f20a86bc5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:02.975339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9061f-77bc-47f3-84ea-c8ee12886bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:02.976286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9061f-77bc-47f3-84ea-c8ee12886bb6 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:02.976690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9061f-77bc-47f3-84ea-c8ee12886bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:02.977092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9061f-77bc-47f3-84ea-c8ee12886bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:02.989425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9061f-77bc-47f3-84ea-c8ee12886bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:02.991060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9061f-77bc-47f3-84ea-c8ee12886bb6 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:03.009133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 669/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:07:05.690190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507706-5d85-49b2-9376-1c131dd5f0e9 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:05.691514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507706-5d85-49b2-9376-1c131dd5f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:05.691514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507706-5d85-49b2-9376-1c131dd5f0e9 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:05.694352 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 660/1329] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:05 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:05.703393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab771d9-60bf-4228-99c3-ef435b9d3607 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:05.704531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab771d9-60bf-4228-99c3-ef435b9d3607 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:05.704531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab771d9-60bf-4228-99c3-ef435b9d3607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:05.723198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-eab771d9-60bf-4228-99c3-ef435b9d3607 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:05.725018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-eab771d9-60bf-4228-99c3-ef435b9d3607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:05.733907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 670/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:07:05.805069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3507706-5d85-49b2-9376-1c131dd5f0e9 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:05.824203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3507706-5d85-49b2-9376-1c131dd5f0e9 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:05.831753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d634b-1968-4e81-a63d-d2afb5504665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:05.832657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d634b-1968-4e81-a63d-d2afb5504665 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:05.832998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d634b-1968-4e81-a63d-d2afb5504665 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:05.833353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d634b-1968-4e81-a63d-d2afb5504665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:05.844702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d634b-1968-4e81-a63d-d2afb5504665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:05.846865 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d634b-1968-4e81-a63d-d2afb5504665 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:05.860602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 661/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:07:08.870013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d0121-9f40-4b50-89c5-4a2c6eb0bf2e None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:08.870763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d0121-9f40-4b50-89c5-4a2c6eb0bf2e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:08.870763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d0121-9f40-4b50-89c5-4a2c6eb0bf2e None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:08.872358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 671/1332] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:08.878633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3058-ee97-4e65-b09b-58a79d879438 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:08.879136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3058-ee97-4e65-b09b-58a79d879438 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:08.879323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3058-ee97-4e65-b09b-58a79d879438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:08.898263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d6ae3058-ee97-4e65-b09b-58a79d879438 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:08.899508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d6ae3058-ee97-4e65-b09b-58a79d879438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:08.907442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 662/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:08.962702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d0121-9f40-4b50-89c5-4a2c6eb0bf2e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:08.981683 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d0121-9f40-4b50-89c5-4a2c6eb0bf2e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:08.991300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68abf0-3d4d-4861-b028-e2cd77cd153a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:08.992408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68abf0-3d4d-4861-b028-e2cd77cd153a service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:08.992901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68abf0-3d4d-4861-b028-e2cd77cd153a service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:08.993390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68abf0-3d4d-4861-b028-e2cd77cd153a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:09.009370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68abf0-3d4d-4861-b028-e2cd77cd153a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:09.012322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68abf0-3d4d-4861-b028-e2cd77cd153a service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:09.027597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 672/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:07:10.697933 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410f41-2ed6-4d2c-8320-8bf0fc8c1765 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:10.698847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410f41-2ed6-4d2c-8320-8bf0fc8c1765 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:10.698847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410f41-2ed6-4d2c-8320-8bf0fc8c1765 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:10.700307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 663/1335] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:07:10.708502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb828-8b6f-4e82-bdd8-ebae05b51246 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:10.709019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb828-8b6f-4e82-bdd8-ebae05b51246 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:10.709477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb828-8b6f-4e82-bdd8-ebae05b51246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:10.747191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-637bb828-8b6f-4e82-bdd8-ebae05b51246 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:10.759475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-637bb828-8b6f-4e82-bdd8-ebae05b51246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:10.777215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 673/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:10.850409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db242aa-dcf7-4d57-af3d-3ad39b0ed7af None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:10.850939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db242aa-dcf7-4d57-af3d-3ad39b0ed7af None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:10.851416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db242aa-dcf7-4d57-af3d-3ad39b0ed7af None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:10.854693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 664/1337] 10.222.0.16 () {54 vars in 962 bytes} [Thu Nov 11 17:07:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:10.864686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d3eef-cd1a-4655-a308-7da2c3d1f912 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:10.865100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d3eef-cd1a-4655-a308-7da2c3d1f912 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:10.865524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d3eef-cd1a-4655-a308-7da2c3d1f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:10.938527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-1b6d3eef-cd1a-4655-a308-7da2c3d1f912 None None] MFA Rules not processed for user `8a061423c1f646b8892d646979f84f20`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:10.940504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1b6d3eef-cd1a-4655-a308-7da2c3d1f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:11.015439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 674/1338] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Nov 11 17:07:10 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:07:11.030041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db242aa-dcf7-4d57-af3d-3ad39b0ed7af None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:11.043023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db242aa-dcf7-4d57-af3d-3ad39b0ed7af None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:11.046809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e0d3c-0715-4256-8f1f-42535d984245 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a061423c1f646b8892d646979f84f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:11.047456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0d3c-0715-4256-8f1f-42535d984245 service glance] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:11.047735 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0d3c-0715-4256-8f1f-42535d984245 service glance] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:11.048016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e0d3c-0715-4256-8f1f-42535d984245 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:11.058613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e0d3c-0715-4256-8f1f-42535d984245 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:11.060065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e0d3c-0715-4256-8f1f-42535d984245 service glance] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:11.071445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 665/1339] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:07:11.848170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937510-5fa1-41a5-8aaa-391e8cd893cc None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:11.849788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937510-5fa1-41a5-8aaa-391e8cd893cc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:11.849788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937510-5fa1-41a5-8aaa-391e8cd893cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:11.922865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-48937510-5fa1-41a5-8aaa-391e8cd893cc None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:11.924267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-48937510-5fa1-41a5-8aaa-391e8cd893cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:11.972797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2784-9a61-4d82-b5e7-87695073f950 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:11.973879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2784-9a61-4d82-b5e7-87695073f950 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:11.974298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2784-9a61-4d82-b5e7-87695073f950 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:11.976661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 666/1340] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:07:11.983509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ec17-b458-4004-a4b9-877b11cde938 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:11.983778 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ec17-b458-4004-a4b9-877b11cde938 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:11.984063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ec17-b458-4004-a4b9-877b11cde938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:12.005830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1670ec17-b458-4004-a4b9-877b11cde938 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:12.007118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1670ec17-b458-4004-a4b9-877b11cde938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:12.015691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 667/1341] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:07:12.028113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 675/1342] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:07:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:07:12.070317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ec17-b458-4004-a4b9-877b11cde938 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:12.085117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ec17-b458-4004-a4b9-877b11cde938 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:12.091667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0bcfd-dd8e-446c-8b00-e3e54ef55c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:12.091952 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580d32-d304-4746-b362-735f9d97fc00 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:12.092193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580d32-d304-4746-b362-735f9d97fc00 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:12.092472 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580d32-d304-4746-b362-735f9d97fc00 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:12.092642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0bcfd-dd8e-446c-8b00-e3e54ef55c40 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:12.093041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0bcfd-dd8e-446c-8b00-e3e54ef55c40 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:12.093453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0bcfd-dd8e-446c-8b00-e3e54ef55c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:12.094385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 676/1343] 10.222.0.16 () {54 vars in 942 bytes} [Thu Nov 11 17:07:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:07:12.104043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6392b-d57a-4e7e-a804-a6d018e89ae6 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:12.104489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6392b-d57a-4e7e-a804-a6d018e89ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:12.107120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6392b-d57a-4e7e-a804-a6d018e89ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:12.107239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0bcfd-dd8e-446c-8b00-e3e54ef55c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:12.107239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0bcfd-dd8e-446c-8b00-e3e54ef55c40 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:12.120896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 668/1344] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:07:12.175810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-28c6392b-d57a-4e7e-a804-a6d018e89ae6 None None] MFA Rules not processed for user `cc5d09e583e942e998f2c9808f1dc5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:12.177030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-28c6392b-d57a-4e7e-a804-a6d018e89ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:12.276313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 677/1345] 10.222.0.16 () {58 vars in 1039 bytes} [Thu Nov 11 17:07:12 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:12.289605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0bcfd-dd8e-446c-8b00-e3e54ef55c40 service nova] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:12.300968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0bcfd-dd8e-446c-8b00-e3e54ef55c40 service nova] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:12.307316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8a816-312f-4525-9406-6121f4b11964 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:12.308123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a816-312f-4525-9406-6121f4b11964 service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:12.308447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a816-312f-4525-9406-6121f4b11964 service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:12.308759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8a816-312f-4525-9406-6121f4b11964 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:12.318556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8a816-312f-4525-9406-6121f4b11964 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:12.320244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8a816-312f-4525-9406-6121f4b11964 service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:12.329183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 669/1346] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:07:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:07:14.868268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318878-ea3d-49c6-9ee0-1e47838987a3 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:14.869121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318878-ea3d-49c6-9ee0-1e47838987a3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:14.869121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318878-ea3d-49c6-9ee0-1e47838987a3 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:14.870677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 678/1347] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:07:14.877500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19147145-20c9-426c-9a1e-d47a79c5e85e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:14.878300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19147145-20c9-426c-9a1e-d47a79c5e85e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:14.878300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19147145-20c9-426c-9a1e-d47a79c5e85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:14.898831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-19147145-20c9-426c-9a1e-d47a79c5e85e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:14.899943 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-19147145-20c9-426c-9a1e-d47a79c5e85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:14.908387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 670/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:14.965222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318878-ea3d-49c6-9ee0-1e47838987a3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:14.981153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318878-ea3d-49c6-9ee0-1e47838987a3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:14.987955 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963b2c6-20ff-4f67-9c02-fcb49326d349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:14.988625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963b2c6-20ff-4f67-9c02-fcb49326d349 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:14.989572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963b2c6-20ff-4f67-9c02-fcb49326d349 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:14.989867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963b2c6-20ff-4f67-9c02-fcb49326d349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:15.000773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963b2c6-20ff-4f67-9c02-fcb49326d349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:15.002291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963b2c6-20ff-4f67-9c02-fcb49326d349 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:15.015857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 679/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:07:20.121982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83bc0-c6bc-40b1-ae76-2fe31f780024 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:20.122651 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83bc0-c6bc-40b1-ae76-2fe31f780024 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:20.122937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83bc0-c6bc-40b1-ae76-2fe31f780024 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:20.126131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 671/1350] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:20 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:20.137588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d2b9-b8af-4a48-89d7-0ff7a2588f21 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:20.138175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d2b9-b8af-4a48-89d7-0ff7a2588f21 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:20.138446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d2b9-b8af-4a48-89d7-0ff7a2588f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:20.168063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e4b5d2b9-b8af-4a48-89d7-0ff7a2588f21 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:20.169607 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e4b5d2b9-b8af-4a48-89d7-0ff7a2588f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:20.194586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 680/1351] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:20.260230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83bc0-c6bc-40b1-ae76-2fe31f780024 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:20.285587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83bc0-c6bc-40b1-ae76-2fe31f780024 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:20.295955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2259fe-a9d1-4b89-987f-43d5b31a83c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:20.303301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2259fe-a9d1-4b89-987f-43d5b31a83c8 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:20.303794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2259fe-a9d1-4b89-987f-43d5b31a83c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:20.304288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2259fe-a9d1-4b89-987f-43d5b31a83c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:20.322142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2259fe-a9d1-4b89-987f-43d5b31a83c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:20.325435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2259fe-a9d1-4b89-987f-43d5b31a83c8 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:20.340725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 672/1352] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:07:23.672540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ee94-66b0-46b8-b4f3-be34022897a4 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:23.673110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ee94-66b0-46b8-b4f3-be34022897a4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:23.673110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ee94-66b0-46b8-b4f3-be34022897a4 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:23.679171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 681/1353] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:23 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:23.681235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4c0b4-9565-43d1-a5ea-c1a41d6741f6 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:23.681700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4c0b4-9565-43d1-a5ea-c1a41d6741f6 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:23.681862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4c0b4-9565-43d1-a5ea-c1a41d6741f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:23.701789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-94d4c0b4-9565-43d1-a5ea-c1a41d6741f6 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:23.703046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-94d4c0b4-9565-43d1-a5ea-c1a41d6741f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:23.714586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 673/1354] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:07:23.783012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976ee94-66b0-46b8-b4f3-be34022897a4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:23.798434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976ee94-66b0-46b8-b4f3-be34022897a4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:23.804619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0932d0-f22a-4456-b9e8-fa845ea5e1c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:23.805515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0932d0-f22a-4456-b9e8-fa845ea5e1c6 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:23.806031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0932d0-f22a-4456-b9e8-fa845ea5e1c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:23.806510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0932d0-f22a-4456-b9e8-fa845ea5e1c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:23.815954 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0932d0-f22a-4456-b9e8-fa845ea5e1c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:23.818218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0932d0-f22a-4456-b9e8-fa845ea5e1c6 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:23.838934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 682/1355] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:07:32.099875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ba55b-bdae-4198-a82d-5c01ba486e2c None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:32.100625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ba55b-bdae-4198-a82d-5c01ba486e2c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:32.100625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ba55b-bdae-4198-a82d-5c01ba486e2c None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:32.102267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 674/1356] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:32.109251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068ea-20a0-4a13-84b5-e23cd09f1be2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:32.110427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068ea-20a0-4a13-84b5-e23cd09f1be2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:32.110427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca068ea-20a0-4a13-84b5-e23cd09f1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:32.130338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dca068ea-20a0-4a13-84b5-e23cd09f1be2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:32.131588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dca068ea-20a0-4a13-84b5-e23cd09f1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:32.139687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 683/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:32.168193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ba55b-bdae-4198-a82d-5c01ba486e2c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:32.182334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ba55b-bdae-4198-a82d-5c01ba486e2c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:32.186920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4a01-837a-4492-a3e6-e37c1f910381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:32.187576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4a01-837a-4492-a3e6-e37c1f910381 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:32.187861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4a01-837a-4492-a3e6-e37c1f910381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:32.188150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4a01-837a-4492-a3e6-e37c1f910381 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:32.188891 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4a01-837a-4492-a3e6-e37c1f910381 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:32.190832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4a01-837a-4492-a3e6-e37c1f910381 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:32.207719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 675/1358] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 17:07:32 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:07:34.503067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f34f-9a81-4cf5-b617-75cac9eba965 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:34.503710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f34f-9a81-4cf5-b617-75cac9eba965 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:34.503710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f34f-9a81-4cf5-b617-75cac9eba965 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:34.505346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 684/1359] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:34.511978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1336c9-d80a-4b74-9508-287ba6c6a913 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:34.512485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1336c9-d80a-4b74-9508-287ba6c6a913 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:34.512585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1336c9-d80a-4b74-9508-287ba6c6a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:34.531451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-8b1336c9-d80a-4b74-9508-287ba6c6a913 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:34.534970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8b1336c9-d80a-4b74-9508-287ba6c6a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:34.541887 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 676/1360] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:34.566086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3f34f-9a81-4cf5-b617-75cac9eba965 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:34.578941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3f34f-9a81-4cf5-b617-75cac9eba965 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:34.584086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376fecb-9a29-4db1-a5e7-399d714a0234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:34.584936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376fecb-9a29-4db1-a5e7-399d714a0234 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:34.585215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376fecb-9a29-4db1-a5e7-399d714a0234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:34.585520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376fecb-9a29-4db1-a5e7-399d714a0234 admin admin] PATH_INFO: `/v3/projects/15ab56ee3e35403290da0cc00044d7bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:34.597061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376fecb-9a29-4db1-a5e7-399d714a0234 admin admin] RBAC: Authorizing `identity:get_project(project_id=15ab56ee3e35403290da0cc00044d7bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:34.599786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376fecb-9a29-4db1-a5e7-399d714a0234 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:34.601863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 685/1361] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:07:34 2021] GET /identity/v3/projects/15ab56ee3e35403290da0cc00044d7bb => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:34.610636 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1336c9-d80a-4b74-9508-287ba6c6a913 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:34.620289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1336c9-d80a-4b74-9508-287ba6c6a913 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:34.625095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c77b8-1846-4d05-aec2-f53f50e1becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:34.626656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c77b8-1846-4d05-aec2-f53f50e1becc admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:34.626656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c77b8-1846-4d05-aec2-f53f50e1becc admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:34.626656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c77b8-1846-4d05-aec2-f53f50e1becc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:34.627104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c77b8-1846-4d05-aec2-f53f50e1becc admin admin] RBAC: Adding query filter params (scope.project.id=15ab56ee3e35403290da0cc00044d7bb) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:07:34.627409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c77b8-1846-4d05-aec2-f53f50e1becc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:34.629334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c77b8-1846-4d05-aec2-f53f50e1becc admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:34.636701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 677/1362] 10.222.0.16 () {56 vars in 1231 bytes} [Thu Nov 11 17:07:34 2021] GET /identity/v3/role_assignments?scope.project.id=15ab56ee3e35403290da0cc00044d7bb => generated 526 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:34.643490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376fecb-9a29-4db1-a5e7-399d714a0234 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:34.654174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376fecb-9a29-4db1-a5e7-399d714a0234 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:34.658950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41863d-6249-41ca-9c55-7a49e66708b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:34.659848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41863d-6249-41ca-9c55-7a49e66708b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:34.660843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41863d-6249-41ca-9c55-7a49e66708b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:34.661140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41863d-6249-41ca-9c55-7a49e66708b6 admin admin] PATH_INFO: `/v3/users/311c3582f0b94c29b2773959ebfc1954` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:34.676236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41863d-6249-41ca-9c55-7a49e66708b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=311c3582f0b94c29b2773959ebfc1954)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:34.678428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41863d-6249-41ca-9c55-7a49e66708b6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:34.680278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 686/1363] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:34 2021] GET /identity/v3/users/311c3582f0b94c29b2773959ebfc1954 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:37.013882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae9ecb-b9c4-4324-b0b8-b3c112b126ce None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:37.014467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae9ecb-b9c4-4324-b0b8-b3c112b126ce None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:37.014467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae9ecb-b9c4-4324-b0b8-b3c112b126ce None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:37.016245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 678/1364] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:37.022616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c04bb-fdd6-4017-903e-c1a1c8e925a7 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:37.023037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c04bb-fdd6-4017-903e-c1a1c8e925a7 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:37.023128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c04bb-fdd6-4017-903e-c1a1c8e925a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:37.040647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-f59c04bb-fdd6-4017-903e-c1a1c8e925a7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:37.041831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f59c04bb-fdd6-4017-903e-c1a1c8e925a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:37.049515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 687/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:37.073139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae9ecb-b9c4-4324-b0b8-b3c112b126ce None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:37.085893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae9ecb-b9c4-4324-b0b8-b3c112b126ce None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:37.090587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b823-79d1-43bf-a015-f1f9e91ab065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:37.091437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b823-79d1-43bf-a015-f1f9e91ab065 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:37.091716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b823-79d1-43bf-a015-f1f9e91ab065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:37.091989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43b823-79d1-43bf-a015-f1f9e91ab065 admin admin] PATH_INFO: `/v3/projects/1c0ef93ed47f47b48477133baa64eafa` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:37.103677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43b823-79d1-43bf-a015-f1f9e91ab065 admin admin] RBAC: Authorizing `identity:get_project(project_id=1c0ef93ed47f47b48477133baa64eafa)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:37.105737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43b823-79d1-43bf-a015-f1f9e91ab065 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:37.107698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 679/1366] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:07:37 2021] GET /identity/v3/projects/1c0ef93ed47f47b48477133baa64eafa => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:37.116175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c04bb-fdd6-4017-903e-c1a1c8e925a7 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:37.125166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c04bb-fdd6-4017-903e-c1a1c8e925a7 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:37.129687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:37.130316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:37.130609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:37.130880 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:37.131656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] RBAC: Adding query filter params (scope.project.id=1c0ef93ed47f47b48477133baa64eafa) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:07:37.131955 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:37.133769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:37.140421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 688/1367] 10.222.0.16 () {56 vars in 1231 bytes} [Thu Nov 11 17:07:37 2021] GET /identity/v3/role_assignments?scope.project.id=1c0ef93ed47f47b48477133baa64eafa => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:37.147576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b823-79d1-43bf-a015-f1f9e91ab065 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:37.157258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43b823-79d1-43bf-a015-f1f9e91ab065 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:37.162694 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b5b07-3f60-49e9-a657-a9ee4ca14499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:37.163557 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b5b07-3f60-49e9-a657-a9ee4ca14499 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:37.163840 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b5b07-3f60-49e9-a657-a9ee4ca14499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:37.164113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b5b07-3f60-49e9-a657-a9ee4ca14499 admin admin] PATH_INFO: `/v3/users/6aa5f349e7fb4b92ba925967800fb603` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:37.177613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b5b07-3f60-49e9-a657-a9ee4ca14499 admin admin] RBAC: Authorizing `identity:get_user(user_id=6aa5f349e7fb4b92ba925967800fb603)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:37.179821 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b5b07-3f60-49e9-a657-a9ee4ca14499 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:37.181498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 680/1368] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:37 2021] GET /identity/v3/users/6aa5f349e7fb4b92ba925967800fb603 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:07:37.187944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:37.198124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1ba3-9664-4d90-8f0c-6ba2f71cfa6c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:37.202649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944b867-248e-4657-a782-d9e015192ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:37.203511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944b867-248e-4657-a782-d9e015192ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:37.203816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944b867-248e-4657-a782-d9e015192ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:37.204086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944b867-248e-4657-a782-d9e015192ac7 admin admin] PATH_INFO: `/v3/users/b8d6bf7c218b4f95a7e24061c63a4f25` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:37.218003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944b867-248e-4657-a782-d9e015192ac7 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8d6bf7c218b4f95a7e24061c63a4f25)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:37.220169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944b867-248e-4657-a782-d9e015192ac7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:37.221795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 689/1369] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:37 2021] GET /identity/v3/users/b8d6bf7c218b4f95a7e24061c63a4f25 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:39.568726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de695697-68e1-481f-a5c7-42a5eaaa15f1 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:39.569254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de695697-68e1-481f-a5c7-42a5eaaa15f1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:39.569254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de695697-68e1-481f-a5c7-42a5eaaa15f1 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:39.571099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 681/1370] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:39.577256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97ed60-73d9-4377-8236-efaa37faecc1 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:39.577696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97ed60-73d9-4377-8236-efaa37faecc1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:39.577794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97ed60-73d9-4377-8236-efaa37faecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:39.595878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0d97ed60-73d9-4377-8236-efaa37faecc1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:39.597065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0d97ed60-73d9-4377-8236-efaa37faecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:39.604795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 690/1371] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:39.629613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de695697-68e1-481f-a5c7-42a5eaaa15f1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:39.642040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de695697-68e1-481f-a5c7-42a5eaaa15f1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:39.647030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee44f5-0022-4404-8bd1-fe7d628e50df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:39.651993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee44f5-0022-4404-8bd1-fe7d628e50df admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:39.651993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee44f5-0022-4404-8bd1-fe7d628e50df admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:39.651993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee44f5-0022-4404-8bd1-fe7d628e50df admin admin] PATH_INFO: `/v3/projects/228f82a87402494091419a53baea360a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:39.658963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee44f5-0022-4404-8bd1-fe7d628e50df admin admin] RBAC: Authorizing `identity:get_project(project_id=228f82a87402494091419a53baea360a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:39.661084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee44f5-0022-4404-8bd1-fe7d628e50df admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:39.662841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 682/1372] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:07:39 2021] GET /identity/v3/projects/228f82a87402494091419a53baea360a => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:39.671116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97ed60-73d9-4377-8236-efaa37faecc1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:39.680331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97ed60-73d9-4377-8236-efaa37faecc1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:39.684883 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a39f8e-578d-4702-a86c-a1fdc2575339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:39.685516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39f8e-578d-4702-a86c-a1fdc2575339 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:39.685798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39f8e-578d-4702-a86c-a1fdc2575339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:39.686064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39f8e-578d-4702-a86c-a1fdc2575339 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:39.686874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a39f8e-578d-4702-a86c-a1fdc2575339 admin admin] RBAC: Adding query filter params (scope.project.id=228f82a87402494091419a53baea360a) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:07:39.687177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a39f8e-578d-4702-a86c-a1fdc2575339 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:39.689106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a39f8e-578d-4702-a86c-a1fdc2575339 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:39.695302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 691/1373] 10.222.0.16 () {56 vars in 1231 bytes} [Thu Nov 11 17:07:39 2021] GET /identity/v3/role_assignments?scope.project.id=228f82a87402494091419a53baea360a => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:07:39.701900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee44f5-0022-4404-8bd1-fe7d628e50df admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:39.712161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee44f5-0022-4404-8bd1-fe7d628e50df admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:39.716642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170bb3b-9d2b-4d5e-91b0-b5375d10fa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:39.717559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170bb3b-9d2b-4d5e-91b0-b5375d10fa16 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:39.717834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170bb3b-9d2b-4d5e-91b0-b5375d10fa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:39.718105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170bb3b-9d2b-4d5e-91b0-b5375d10fa16 admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:39.731480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170bb3b-9d2b-4d5e-91b0-b5375d10fa16 admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:39.733605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170bb3b-9d2b-4d5e-91b0-b5375d10fa16 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:39.735648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 683/1374] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:39 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:42.033740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6265df-55c4-404c-a0c5-7f7be853d5c0 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:42.034314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6265df-55c4-404c-a0c5-7f7be853d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:42.034314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6265df-55c4-404c-a0c5-7f7be853d5c0 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:42.036159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 692/1375] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:42.042033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3f84-ff3e-444b-9a3b-b58d9f9f1722 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:42.042443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3f84-ff3e-444b-9a3b-b58d9f9f1722 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:42.042611 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3f84-ff3e-444b-9a3b-b58d9f9f1722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:42.059881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c23f3f84-ff3e-444b-9a3b-b58d9f9f1722 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:42.061052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c23f3f84-ff3e-444b-9a3b-b58d9f9f1722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:42.069365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 684/1376] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:42.092825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6265df-55c4-404c-a0c5-7f7be853d5c0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:42.105030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6265df-55c4-404c-a0c5-7f7be853d5c0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:42.110014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701e2e-66f3-41ae-98cd-d0c3bd8ecc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:42.120083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701e2e-66f3-41ae-98cd-d0c3bd8ecc08 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:42.120083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701e2e-66f3-41ae-98cd-d0c3bd8ecc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:42.120083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701e2e-66f3-41ae-98cd-d0c3bd8ecc08 admin admin] PATH_INFO: `/v3/projects/4b30188d19194873aed7f02c87d439bb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:42.123484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5701e2e-66f3-41ae-98cd-d0c3bd8ecc08 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b30188d19194873aed7f02c87d439bb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:42.125581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5701e2e-66f3-41ae-98cd-d0c3bd8ecc08 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:42.127325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 693/1377] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:07:42 2021] GET /identity/v3/projects/4b30188d19194873aed7f02c87d439bb => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:42.136078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3f84-ff3e-444b-9a3b-b58d9f9f1722 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:42.145381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3f84-ff3e-444b-9a3b-b58d9f9f1722 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:42.149958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:42.150633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:42.150914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:42.151186 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:42.151961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] RBAC: Adding query filter params (scope.project.id=4b30188d19194873aed7f02c87d439bb) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:07:42.152265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:42.154103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:42.161352 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 685/1378] 10.222.0.16 () {56 vars in 1231 bytes} [Thu Nov 11 17:07:42 2021] GET /identity/v3/role_assignments?scope.project.id=4b30188d19194873aed7f02c87d439bb => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:07:42.167985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701e2e-66f3-41ae-98cd-d0c3bd8ecc08 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:42.178658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701e2e-66f3-41ae-98cd-d0c3bd8ecc08 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:42.183208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48045-3c06-423b-9bc3-5a9f650f7066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:42.184064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48045-3c06-423b-9bc3-5a9f650f7066 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:42.184345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48045-3c06-423b-9bc3-5a9f650f7066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:42.184619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48045-3c06-423b-9bc3-5a9f650f7066 admin admin] PATH_INFO: `/v3/users/586f2ce919e340b9a2c07caa44e20460` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:42.185803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48045-3c06-423b-9bc3-5a9f650f7066 admin admin] RBAC: Authorizing `identity:get_user(user_id=586f2ce919e340b9a2c07caa44e20460)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:42.187980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48045-3c06-423b-9bc3-5a9f650f7066 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:42.189564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 694/1379] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:42 2021] GET /identity/v3/users/586f2ce919e340b9a2c07caa44e20460 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:42.196778 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:42.206386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b73f72-1139-40c6-aec7-4479295181c6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:42.210930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5cfa-b4d6-4e7d-96ac-ffee4092ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:42.211783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5cfa-b4d6-4e7d-96ac-ffee4092ecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:42.212061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5cfa-b4d6-4e7d-96ac-ffee4092ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:42.212339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5cfa-b4d6-4e7d-96ac-ffee4092ecc3 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:42.213522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5cfa-b4d6-4e7d-96ac-ffee4092ecc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:42.215357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5cfa-b4d6-4e7d-96ac-ffee4092ecc3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:42.216924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 686/1380] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:42 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:44.647410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456113-9d42-4799-8b91-da8fdd62c418 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:44.647983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456113-9d42-4799-8b91-da8fdd62c418 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:44.647983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94456113-9d42-4799-8b91-da8fdd62c418 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:44.649747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 695/1381] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:07:44.655592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f40e-b1df-4402-aa23-681a4ca8b97d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:44.656002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f40e-b1df-4402-aa23-681a4ca8b97d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:44.656142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85f40e-b1df-4402-aa23-681a4ca8b97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:44.674074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4b85f40e-b1df-4402-aa23-681a4ca8b97d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:44.675312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4b85f40e-b1df-4402-aa23-681a4ca8b97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:44.683062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 687/1382] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:44.707804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94456113-9d42-4799-8b91-da8fdd62c418 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:44.719842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94456113-9d42-4799-8b91-da8fdd62c418 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:44.724282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69657254-71c3-46bc-aa97-2804b7e4ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:44.725115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69657254-71c3-46bc-aa97-2804b7e4ef62 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:44.725395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69657254-71c3-46bc-aa97-2804b7e4ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:44.725669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69657254-71c3-46bc-aa97-2804b7e4ef62 admin admin] PATH_INFO: `/v3/projects/a4565572e31b4ffe8a733d9183cd77c5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:44.736197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69657254-71c3-46bc-aa97-2804b7e4ef62 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4565572e31b4ffe8a733d9183cd77c5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:44.738318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69657254-71c3-46bc-aa97-2804b7e4ef62 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:44.740002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 696/1383] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:07:44 2021] GET /identity/v3/projects/a4565572e31b4ffe8a733d9183cd77c5 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:07:44.748144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85f40e-b1df-4402-aa23-681a4ca8b97d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:44.757529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85f40e-b1df-4402-aa23-681a4ca8b97d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:44.762134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:44.762815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:44.763098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:44.763374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:44.764145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] RBAC: Adding query filter params (scope.project.id=a4565572e31b4ffe8a733d9183cd77c5) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:07:44.764449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:44.766267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:44.773438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 688/1384] 10.222.0.16 () {56 vars in 1231 bytes} [Thu Nov 11 17:07:44 2021] GET /identity/v3/role_assignments?scope.project.id=a4565572e31b4ffe8a733d9183cd77c5 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:07:44.779896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69657254-71c3-46bc-aa97-2804b7e4ef62 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:44.789642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69657254-71c3-46bc-aa97-2804b7e4ef62 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:44.794284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065aa92-deb2-4f3b-8a4f-5603009bceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:44.795173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065aa92-deb2-4f3b-8a4f-5603009bceb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:44.795451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065aa92-deb2-4f3b-8a4f-5603009bceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:44.795722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065aa92-deb2-4f3b-8a4f-5603009bceb1 admin admin] PATH_INFO: `/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:44.809109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065aa92-deb2-4f3b-8a4f-5603009bceb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=46d57aabf3dc4fcf84eaa3fa986b6462)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:44.811661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065aa92-deb2-4f3b-8a4f-5603009bceb1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:44.813306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 697/1385] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:44 2021] GET /identity/v3/users/46d57aabf3dc4fcf84eaa3fa986b6462 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:44.820333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:44.829845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd610-54f3-41f5-9466-8afd8bff5177 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:44.835075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11968cf2-a387-4490-a5a3-6d3077d2cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:44.835928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968cf2-a387-4490-a5a3-6d3077d2cb47 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:44.836207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968cf2-a387-4490-a5a3-6d3077d2cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:44.836477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968cf2-a387-4490-a5a3-6d3077d2cb47 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:44.837664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11968cf2-a387-4490-a5a3-6d3077d2cb47 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:44.839549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11968cf2-a387-4490-a5a3-6d3077d2cb47 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:44.841139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 689/1386] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:44 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:47.195967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686f80-67fd-465c-8b51-87f6f0d25787 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:47.196450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686f80-67fd-465c-8b51-87f6f0d25787 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:47.196563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686f80-67fd-465c-8b51-87f6f0d25787 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:47.198262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 698/1387] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:47.204281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce6e3-f224-41cc-9ee9-c7c8f514a747 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:47.204748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce6e3-f224-41cc-9ee9-c7c8f514a747 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:47.204848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ce6e3-f224-41cc-9ee9-c7c8f514a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:47.224325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5d5ce6e3-f224-41cc-9ee9-c7c8f514a747 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:47.225502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5d5ce6e3-f224-41cc-9ee9-c7c8f514a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:47.233600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 690/1388] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:47.259787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66686f80-67fd-465c-8b51-87f6f0d25787 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:47.273224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66686f80-67fd-465c-8b51-87f6f0d25787 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:47.277703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110441-6884-4912-854d-ee2bcf5df318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:47.278570 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110441-6884-4912-854d-ee2bcf5df318 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:47.278853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110441-6884-4912-854d-ee2bcf5df318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:47.279124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110441-6884-4912-854d-ee2bcf5df318 admin admin] PATH_INFO: `/v3/projects/a62f9c4d0b7f4443a8eb78e076640010` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:47.280300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0110441-6884-4912-854d-ee2bcf5df318 admin admin] RBAC: Authorizing `identity:get_project(project_id=a62f9c4d0b7f4443a8eb78e076640010)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:47.282177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0110441-6884-4912-854d-ee2bcf5df318 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:47.283829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 699/1389] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:07:47 2021] GET /identity/v3/projects/a62f9c4d0b7f4443a8eb78e076640010 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:07:47.292571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ce6e3-f224-41cc-9ee9-c7c8f514a747 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:47.301969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ce6e3-f224-41cc-9ee9-c7c8f514a747 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:47.306563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c98cc9-bda5-4bac-9adb-8d6273d4c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:47.307243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98cc9-bda5-4bac-9adb-8d6273d4c5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:47.307525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98cc9-bda5-4bac-9adb-8d6273d4c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:47.307799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98cc9-bda5-4bac-9adb-8d6273d4c5fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:47.308574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c98cc9-bda5-4bac-9adb-8d6273d4c5fd admin admin] RBAC: Adding query filter params (scope.project.id=a62f9c4d0b7f4443a8eb78e076640010) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:07:47.308880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c98cc9-bda5-4bac-9adb-8d6273d4c5fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:47.310763 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c98cc9-bda5-4bac-9adb-8d6273d4c5fd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:47.316630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 691/1390] 10.222.0.16 () {56 vars in 1231 bytes} [Thu Nov 11 17:07:47 2021] GET /identity/v3/role_assignments?scope.project.id=a62f9c4d0b7f4443a8eb78e076640010 => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:47.323289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110441-6884-4912-854d-ee2bcf5df318 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:47.333900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110441-6884-4912-854d-ee2bcf5df318 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:47.338487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270be1f2-77c3-4108-9ee4-8b5e2deee0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:47.339405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be1f2-77c3-4108-9ee4-8b5e2deee0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:47.339684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be1f2-77c3-4108-9ee4-8b5e2deee0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:47.339958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be1f2-77c3-4108-9ee4-8b5e2deee0b8 admin admin] PATH_INFO: `/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:47.341143 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270be1f2-77c3-4108-9ee4-8b5e2deee0b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ae4cc8e79cb47cc8c55c2d79c2c09d0)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:47.342973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270be1f2-77c3-4108-9ee4-8b5e2deee0b8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:47.344589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 700/1391] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:47 2021] GET /identity/v3/users/2ae4cc8e79cb47cc8c55c2d79c2c09d0 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:49.669387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edfb25-3752-4096-827f-d74bef6c213e None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:49.669975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edfb25-3752-4096-827f-d74bef6c213e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:49.669975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edfb25-3752-4096-827f-d74bef6c213e None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:49.671733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 692/1392] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:49.677591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e27c83-6013-4a78-8f45-bdb469fa1c43 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:49.677999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e27c83-6013-4a78-8f45-bdb469fa1c43 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:49.678185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e27c83-6013-4a78-8f45-bdb469fa1c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:49.695383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-39e27c83-6013-4a78-8f45-bdb469fa1c43 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:49.696555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-39e27c83-6013-4a78-8f45-bdb469fa1c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:49.704162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 701/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:49.728646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edfb25-3752-4096-827f-d74bef6c213e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:49.740968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edfb25-3752-4096-827f-d74bef6c213e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:49.745303 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8ba75-f09f-412e-beeb-668d5a8d5fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:49.746132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ba75-f09f-412e-beeb-668d5a8d5fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:49.746410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ba75-f09f-412e-beeb-668d5a8d5fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:49.746714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ba75-f09f-412e-beeb-668d5a8d5fe3 admin admin] PATH_INFO: `/v3/projects/bad71aad432042d8a59a9569f81a090e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:49.756918 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8ba75-f09f-412e-beeb-668d5a8d5fe3 admin admin] RBAC: Authorizing `identity:get_project(project_id=bad71aad432042d8a59a9569f81a090e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:49.759009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8ba75-f09f-412e-beeb-668d5a8d5fe3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:49.760669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 693/1394] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Nov 11 17:07:49 2021] GET /identity/v3/projects/bad71aad432042d8a59a9569f81a090e => generated 361 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:49.768509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e27c83-6013-4a78-8f45-bdb469fa1c43 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:49.777854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e27c83-6013-4a78-8f45-bdb469fa1c43 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:49.782275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fce3c-73e7-4314-9a7a-b5bdc2afb136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:49.782939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fce3c-73e7-4314-9a7a-b5bdc2afb136 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:49.783214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fce3c-73e7-4314-9a7a-b5bdc2afb136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:49.783480 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fce3c-73e7-4314-9a7a-b5bdc2afb136 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:49.784231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fce3c-73e7-4314-9a7a-b5bdc2afb136 admin admin] RBAC: Adding query filter params (scope.project.id=bad71aad432042d8a59a9569f81a090e) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:07:49.785126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fce3c-73e7-4314-9a7a-b5bdc2afb136 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:49.787023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fce3c-73e7-4314-9a7a-b5bdc2afb136 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:49.792299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 702/1395] 10.222.0.16 () {56 vars in 1231 bytes} [Thu Nov 11 17:07:49 2021] GET /identity/v3/role_assignments?scope.project.id=bad71aad432042d8a59a9569f81a090e => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:49.798739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8ba75-f09f-412e-beeb-668d5a8d5fe3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:49.808213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8ba75-f09f-412e-beeb-668d5a8d5fe3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:49.812709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c90bb-36d9-45d4-9422-3e5e38cf247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:49.813553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c90bb-36d9-45d4-9422-3e5e38cf247d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:49.813831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c90bb-36d9-45d4-9422-3e5e38cf247d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:49.814100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c90bb-36d9-45d4-9422-3e5e38cf247d admin admin] PATH_INFO: `/v3/users/e857abeb60bc4dc1a4e77460d99e20c2` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:49.827098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c90bb-36d9-45d4-9422-3e5e38cf247d admin admin] RBAC: Authorizing `identity:get_user(user_id=e857abeb60bc4dc1a4e77460d99e20c2)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:49.829213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c90bb-36d9-45d4-9422-3e5e38cf247d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:49.830850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 694/1396] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Nov 11 17:07:49 2021] GET /identity/v3/users/e857abeb60bc4dc1a4e77460d99e20c2 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:07:54.996952 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd88f0-3c57-46b0-b381-472203b3788c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:54.997551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd88f0-3c57-46b0-b381-472203b3788c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:54.997551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd88f0-3c57-46b0-b381-472203b3788c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:54.999273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 703/1397] 10.222.0.16 () {54 vars in 918 bytes} [Thu Nov 11 17:07:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:55.005145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4d72d-988c-4270-af16-5823b265cd1d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:55.005600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4d72d-988c-4270-af16-5823b265cd1d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:55.005758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4d72d-988c-4270-af16-5823b265cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:55.023302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5fb4d72d-988c-4270-af16-5823b265cd1d None None] MFA Rules not processed for user `db055fddc41c4eb0ba1c3b410e1e8e03`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:55.024502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5fb4d72d-988c-4270-af16-5823b265cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:55.032878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 695/1398] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Nov 11 17:07:55 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:55.048787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084c08-4903-451b-933c-5e20851c1419 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:55.049070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084c08-4903-451b-933c-5e20851c1419 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:55.049342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99084c08-4903-451b-933c-5e20851c1419 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:55.051211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 704/1399] 10.222.0.16 () {54 vars in 918 bytes} [Thu Nov 11 17:07:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:55.056947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732c48-a154-4509-a8cb-4ecbf3c66d57 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:55.057237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732c48-a154-4509-a8cb-4ecbf3c66d57 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:55.057516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732c48-a154-4509-a8cb-4ecbf3c66d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:55.075294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-07732c48-a154-4509-a8cb-4ecbf3c66d57 None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:55.076480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-07732c48-a154-4509-a8cb-4ecbf3c66d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:55.085881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 696/1400] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Nov 11 17:07:55 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:57.867951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54883c6-b020-48fc-8e56-40a9f1bf6f66 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:57.868556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54883c6-b020-48fc-8e56-40a9f1bf6f66 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:57.868556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54883c6-b020-48fc-8e56-40a9f1bf6f66 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:57.870873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 705/1401] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:07:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:57.876975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcdc0f-fc2a-4373-b369-1e3f198e2e27 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:57.877429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcdc0f-fc2a-4373-b369-1e3f198e2e27 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:57.877551 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcdc0f-fc2a-4373-b369-1e3f198e2e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:57.895804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9afcdc0f-fc2a-4373-b369-1e3f198e2e27 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:57.896968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9afcdc0f-fc2a-4373-b369-1e3f198e2e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:57.904832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 697/1402] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:07:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:57.959323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54883c6-b020-48fc-8e56-40a9f1bf6f66 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:57.973607 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54883c6-b020-48fc-8e56-40a9f1bf6f66 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:57.978980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9801-10ed-49f0-a302-b6fcf6174e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:57.979611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9801-10ed-49f0-a302-b6fcf6174e4d service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:57.979897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9801-10ed-49f0-a302-b6fcf6174e4d service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:57.980167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9801-10ed-49f0-a302-b6fcf6174e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:57.989308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c9801-10ed-49f0-a302-b6fcf6174e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:57.990919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c9801-10ed-49f0-a302-b6fcf6174e4d service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:58.000135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 706/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:07:59.547029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce105-0c4d-43e8-8c3c-8c195ee29b3a None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:59.547624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce105-0c4d-43e8-8c3c-8c195ee29b3a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:59.547624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce105-0c4d-43e8-8c3c-8c195ee29b3a None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:59.549307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 698/1404] 10.222.0.16 () {54 vars in 911 bytes} [Thu Nov 11 17:07:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:07:59.560985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625866-011a-4157-9ea7-e519fb7e8982 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:59.561616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625866-011a-4157-9ea7-e519fb7e8982 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:59.561616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625866-011a-4157-9ea7-e519fb7e8982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:59.582146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0d625866-011a-4157-9ea7-e519fb7e8982 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:07:59.583388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0d625866-011a-4157-9ea7-e519fb7e8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:07:59.591613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 707/1405] 10.222.0.16 () {58 vars in 1008 bytes} [Thu Nov 11 17:07:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:07:59.755496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce105-0c4d-43e8-8c3c-8c195ee29b3a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:07:59.769279 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce105-0c4d-43e8-8c3c-8c195ee29b3a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:07:59.774841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c107d-d803-4773-b48b-3b4e55c57106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:07:59.775506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c107d-d803-4773-b48b-3b4e55c57106 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:07:59.775783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c107d-d803-4773-b48b-3b4e55c57106 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:07:59.776053 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c107d-d803-4773-b48b-3b4e55c57106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:07:59.784585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c107d-d803-4773-b48b-3b4e55c57106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:07:59.786144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c107d-d803-4773-b48b-3b4e55c57106 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:07:59.795206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 699/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:07:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:01.274066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832c058-4a2b-432c-b1b0-6ab4744b8918 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:01.274693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832c058-4a2b-432c-b1b0-6ab4744b8918 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:01.274693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832c058-4a2b-432c-b1b0-6ab4744b8918 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:01.276402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 708/1407] 10.222.0.16 () {54 vars in 911 bytes} [Thu Nov 11 17:08:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:01.282094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef661fa-5663-4c61-8748-0cf4c46cd9ce None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:01.282514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef661fa-5663-4c61-8748-0cf4c46cd9ce None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:01.282707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef661fa-5663-4c61-8748-0cf4c46cd9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:01.301136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-2ef661fa-5663-4c61-8748-0cf4c46cd9ce None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:01.302336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2ef661fa-5663-4c61-8748-0cf4c46cd9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:01.310226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 700/1408] 10.222.0.16 () {58 vars in 1008 bytes} [Thu Nov 11 17:08:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:01.462766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832c058-4a2b-432c-b1b0-6ab4744b8918 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:01.477073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832c058-4a2b-432c-b1b0-6ab4744b8918 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:01.482471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bbce9-71b5-4592-8193-47e152e6fe42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:01.483163 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bbce9-71b5-4592-8193-47e152e6fe42 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:01.483436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bbce9-71b5-4592-8193-47e152e6fe42 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:01.483703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bbce9-71b5-4592-8193-47e152e6fe42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:01.493142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bbce9-71b5-4592-8193-47e152e6fe42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:01.494751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bbce9-71b5-4592-8193-47e152e6fe42 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:01.504008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 709/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:02.992501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d53b90-5323-4886-a34e-45ef5469e7ef None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:02.993066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d53b90-5323-4886-a34e-45ef5469e7ef None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:02.993066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d53b90-5323-4886-a34e-45ef5469e7ef None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:02.994865 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 701/1410] 10.222.0.16 () {54 vars in 911 bytes} [Thu Nov 11 17:08:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:03.000405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee0fc-9e45-4fab-bb43-ed5f57aae11e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:03.000845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee0fc-9e45-4fab-bb43-ed5f57aae11e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:03.000962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee0fc-9e45-4fab-bb43-ed5f57aae11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:03.019495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c8fee0fc-9e45-4fab-bb43-ed5f57aae11e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:03.020684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c8fee0fc-9e45-4fab-bb43-ed5f57aae11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:03.028408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 710/1411] 10.222.0.16 () {58 vars in 1008 bytes} [Thu Nov 11 17:08:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:03.181632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d53b90-5323-4886-a34e-45ef5469e7ef None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:03.196128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d53b90-5323-4886-a34e-45ef5469e7ef None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:03.201347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d3a81-25cb-411e-b36e-1486bf03448f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:03.201973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3a81-25cb-411e-b36e-1486bf03448f service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:03.202251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3a81-25cb-411e-b36e-1486bf03448f service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:03.202518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3a81-25cb-411e-b36e-1486bf03448f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:03.210658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d3a81-25cb-411e-b36e-1486bf03448f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:03.212221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d3a81-25cb-411e-b36e-1486bf03448f service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:03.221698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 702/1412] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:04.703937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb3cf-fadc-4950-8cce-93eeb583fa20 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:04.704498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb3cf-fadc-4950-8cce-93eeb583fa20 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:04.704498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb3cf-fadc-4950-8cce-93eeb583fa20 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:04.706309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 711/1413] 10.222.0.16 () {54 vars in 911 bytes} [Thu Nov 11 17:08:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:04.712835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cd1a9-d1c0-40cd-861e-12fff9892f9e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:04.713367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cd1a9-d1c0-40cd-861e-12fff9892f9e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:04.713367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cd1a9-d1c0-40cd-861e-12fff9892f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:04.731379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4a5cd1a9-d1c0-40cd-861e-12fff9892f9e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:04.732589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4a5cd1a9-d1c0-40cd-861e-12fff9892f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:04.741217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 703/1414] 10.222.0.16 () {58 vars in 1008 bytes} [Thu Nov 11 17:08:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:04.893727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb3cf-fadc-4950-8cce-93eeb583fa20 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:04.907624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb3cf-fadc-4950-8cce-93eeb583fa20 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:04.913460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439ad08-14d5-4295-a798-bce9a2b3cbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:04.914080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ad08-14d5-4295-a798-bce9a2b3cbc7 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:04.914361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ad08-14d5-4295-a798-bce9a2b3cbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:04.914663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ad08-14d5-4295-a798-bce9a2b3cbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:04.922526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439ad08-14d5-4295-a798-bce9a2b3cbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:04.924122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439ad08-14d5-4295-a798-bce9a2b3cbc7 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:04.933953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 712/1415] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:06.394259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b799-d596-41f1-847a-3c0831ebaa7f None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:06.394864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b799-d596-41f1-847a-3c0831ebaa7f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:06.394864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b799-d596-41f1-847a-3c0831ebaa7f None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:06.396619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 704/1416] 10.222.0.16 () {54 vars in 911 bytes} [Thu Nov 11 17:08:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:06.402644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8276-fe83-4686-ad2d-d24580a354cf None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:06.403195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8276-fe83-4686-ad2d-d24580a354cf None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:06.403195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8276-fe83-4686-ad2d-d24580a354cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:06.421968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ee0c8276-fe83-4686-ad2d-d24580a354cf None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:06.423190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ee0c8276-fe83-4686-ad2d-d24580a354cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:06.431509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 713/1417] 10.222.0.16 () {58 vars in 1008 bytes} [Thu Nov 11 17:08:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:06.585528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b799-d596-41f1-847a-3c0831ebaa7f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:06.599818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b799-d596-41f1-847a-3c0831ebaa7f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:06.605205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501990a8-23a9-464d-a58c-6a0336806d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:06.605831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501990a8-23a9-464d-a58c-6a0336806d6d service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:06.606109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501990a8-23a9-464d-a58c-6a0336806d6d service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:06.606382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501990a8-23a9-464d-a58c-6a0336806d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:06.615213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501990a8-23a9-464d-a58c-6a0336806d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:06.616813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501990a8-23a9-464d-a58c-6a0336806d6d service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:06.625917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 705/1418] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:08.092722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93416edf-be30-4de7-a862-4e319f8b68d5 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:08.093302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93416edf-be30-4de7-a862-4e319f8b68d5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:08.093302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93416edf-be30-4de7-a862-4e319f8b68d5 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:08.095198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 714/1419] 10.222.0.16 () {54 vars in 911 bytes} [Thu Nov 11 17:08:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:08.101628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220af1-694e-4144-ae21-eb649b4de651 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:08.102119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220af1-694e-4144-ae21-eb649b4de651 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:08.102224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220af1-694e-4144-ae21-eb649b4de651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:08.120714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3b220af1-694e-4144-ae21-eb649b4de651 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:08.121880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3b220af1-694e-4144-ae21-eb649b4de651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:08.130028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 706/1420] 10.222.0.16 () {58 vars in 1008 bytes} [Thu Nov 11 17:08:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:08:08.284978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93416edf-be30-4de7-a862-4e319f8b68d5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:08.298880 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93416edf-be30-4de7-a862-4e319f8b68d5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:08.304727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00df6-b76c-4e60-8936-33e90a9da818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:08.305349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00df6-b76c-4e60-8936-33e90a9da818 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:08.305624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00df6-b76c-4e60-8936-33e90a9da818 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:08.305891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00df6-b76c-4e60-8936-33e90a9da818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:08.313949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd00df6-b76c-4e60-8936-33e90a9da818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:08.316185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd00df6-b76c-4e60-8936-33e90a9da818 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:08.325189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 715/1421] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:09.812372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c4ae-9bbf-49a2-a591-44438d23c811 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:09.812982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c4ae-9bbf-49a2-a591-44438d23c811 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:09.812982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c4ae-9bbf-49a2-a591-44438d23c811 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:09.814738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 707/1422] 10.222.0.16 () {54 vars in 911 bytes} [Thu Nov 11 17:08:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:09.823869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6381d8-435e-4be8-b971-c16e79e83b11 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:09.824362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6381d8-435e-4be8-b971-c16e79e83b11 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:09.824489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6381d8-435e-4be8-b971-c16e79e83b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:09.843048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-fe6381d8-435e-4be8-b971-c16e79e83b11 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:09.844242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-fe6381d8-435e-4be8-b971-c16e79e83b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:09.851887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 716/1423] 10.222.0.16 () {58 vars in 1008 bytes} [Thu Nov 11 17:08:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:08:10.006302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c4ae-9bbf-49a2-a591-44438d23c811 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:10.020644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c4ae-9bbf-49a2-a591-44438d23c811 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:10.026206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478fbda-84d8-4661-99ba-2cd61124df6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:10.026879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fbda-84d8-4661-99ba-2cd61124df6c service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:10.027162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fbda-84d8-4661-99ba-2cd61124df6c service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:10.027438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fbda-84d8-4661-99ba-2cd61124df6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:10.035455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478fbda-84d8-4661-99ba-2cd61124df6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:10.037036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478fbda-84d8-4661-99ba-2cd61124df6c service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:10.046134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 708/1424] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:08:11.515311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588c78-cb5e-4034-9613-b1fef6bcc31d None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:11.515859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588c78-cb5e-4034-9613-b1fef6bcc31d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:11.515859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588c78-cb5e-4034-9613-b1fef6bcc31d None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:11.517545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 717/1425] 10.222.0.16 () {54 vars in 911 bytes} [Thu Nov 11 17:08:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:11.523289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb9c8-70f5-4394-a238-46dd48c79951 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:11.523729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb9c8-70f5-4394-a238-46dd48c79951 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:11.523850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eb9c8-70f5-4394-a238-46dd48c79951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:11.541297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ee9eb9c8-70f5-4394-a238-46dd48c79951 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:11.542471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ee9eb9c8-70f5-4394-a238-46dd48c79951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:11.550726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 709/1426] 10.222.0.16 () {58 vars in 1008 bytes} [Thu Nov 11 17:08:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:11.705401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6588c78-cb5e-4034-9613-b1fef6bcc31d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:11.719265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6588c78-cb5e-4034-9613-b1fef6bcc31d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:11.725061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc5eff-6205-479e-aa66-e3f072f98df1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:11.725690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5eff-6205-479e-aa66-e3f072f98df1 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:11.725970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5eff-6205-479e-aa66-e3f072f98df1 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:11.726242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5eff-6205-479e-aa66-e3f072f98df1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:11.740937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc5eff-6205-479e-aa66-e3f072f98df1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:11.743658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc5eff-6205-479e-aa66-e3f072f98df1 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:11.755970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 718/1427] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:13.949350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebbbb-65ee-41c4-81e4-d9fe96c6e929 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:13.949919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebbbb-65ee-41c4-81e4-d9fe96c6e929 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:13.949919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebbbb-65ee-41c4-81e4-d9fe96c6e929 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:13.951692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 710/1428] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:13.957643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9163c-1383-4fd5-9246-ff9d3a31c987 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:13.958100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9163c-1383-4fd5-9246-ff9d3a31c987 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:13.958192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9163c-1383-4fd5-9246-ff9d3a31c987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:13.975980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4be9163c-1383-4fd5-9246-ff9d3a31c987 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:13.977159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4be9163c-1383-4fd5-9246-ff9d3a31c987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:13.985147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 719/1429] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:14.026217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebbbb-65ee-41c4-81e4-d9fe96c6e929 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:14.037036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebbbb-65ee-41c4-81e4-d9fe96c6e929 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:14.040475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaad34b-b84b-43df-beb9-a70c96eac6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:14.041094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaad34b-b84b-43df-beb9-a70c96eac6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:14.041370 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaad34b-b84b-43df-beb9-a70c96eac6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:14.041640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaad34b-b84b-43df-beb9-a70c96eac6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:14.050959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaad34b-b84b-43df-beb9-a70c96eac6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:14.052410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaad34b-b84b-43df-beb9-a70c96eac6d4 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:14.061492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 711/1430] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:16.592424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d78c8-26e5-4f9c-bc8e-cc4224b755d4 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:16.592960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d78c8-26e5-4f9c-bc8e-cc4224b755d4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:16.592960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d78c8-26e5-4f9c-bc8e-cc4224b755d4 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:16.594805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 720/1431] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:16.601431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8ab71-1e12-4954-8048-5603c9ba864f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:16.601904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8ab71-1e12-4954-8048-5603c9ba864f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:16.601998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8ab71-1e12-4954-8048-5603c9ba864f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:16.620115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c0b8ab71-1e12-4954-8048-5603c9ba864f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:16.621292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c0b8ab71-1e12-4954-8048-5603c9ba864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:16.629054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 712/1432] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:16.669428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d78c8-26e5-4f9c-bc8e-cc4224b755d4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:16.680598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d78c8-26e5-4f9c-bc8e-cc4224b755d4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:16.684073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec548ea4-87fa-4610-8e33-24a8df308c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:16.684753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548ea4-87fa-4610-8e33-24a8df308c6b service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:16.685025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548ea4-87fa-4610-8e33-24a8df308c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:16.685313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548ea4-87fa-4610-8e33-24a8df308c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:16.694853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec548ea4-87fa-4610-8e33-24a8df308c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:16.697327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec548ea4-87fa-4610-8e33-24a8df308c6b service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:16.705748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 721/1433] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:19.440406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8f54-4995-410f-964e-769576e6f600 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:19.440968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8f54-4995-410f-964e-769576e6f600 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:19.440968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8f54-4995-410f-964e-769576e6f600 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:19.442660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 713/1434] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:19.448497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7045-47ca-4722-a1be-94c7328b7972 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:19.448945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7045-47ca-4722-a1be-94c7328b7972 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:19.449157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e7045-47ca-4722-a1be-94c7328b7972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:19.466409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-db0e7045-47ca-4722-a1be-94c7328b7972 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:19.468847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-db0e7045-47ca-4722-a1be-94c7328b7972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:19.475384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 722/1435] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:19.517287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c8f54-4995-410f-964e-769576e6f600 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:19.527766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c8f54-4995-410f-964e-769576e6f600 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:19.531203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbba14-6b6f-42e8-9e88-6972cb4efa6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:19.531827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbba14-6b6f-42e8-9e88-6972cb4efa6f service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:19.532189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbba14-6b6f-42e8-9e88-6972cb4efa6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:19.532484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbba14-6b6f-42e8-9e88-6972cb4efa6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:19.541185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbba14-6b6f-42e8-9e88-6972cb4efa6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:19.542623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbba14-6b6f-42e8-9e88-6972cb4efa6f service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:19.552136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 714/1436] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:22.032251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542b6a3-8a86-4cff-b071-66db9299b88d None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:22.033360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542b6a3-8a86-4cff-b071-66db9299b88d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:22.033360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542b6a3-8a86-4cff-b071-66db9299b88d None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:22.035126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 723/1437] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:22.041172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c62a5-ab79-43df-b2d6-16ec260618ce None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:22.041622 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c62a5-ab79-43df-b2d6-16ec260618ce None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:22.041716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c62a5-ab79-43df-b2d6-16ec260618ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:22.059768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c45c62a5-ab79-43df-b2d6-16ec260618ce None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:22.060960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c45c62a5-ab79-43df-b2d6-16ec260618ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:22.068701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 715/1438] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:22.110904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542b6a3-8a86-4cff-b071-66db9299b88d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:22.121974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542b6a3-8a86-4cff-b071-66db9299b88d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:22.125525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87334449-46e5-48e9-8ba0-dbb9e795bde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:22.126145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87334449-46e5-48e9-8ba0-dbb9e795bde2 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:22.126420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87334449-46e5-48e9-8ba0-dbb9e795bde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:22.126792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87334449-46e5-48e9-8ba0-dbb9e795bde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:22.135895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87334449-46e5-48e9-8ba0-dbb9e795bde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:22.137316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87334449-46e5-48e9-8ba0-dbb9e795bde2 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:22.146857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 724/1439] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:24.584005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1c6a1-8962-40bb-8d63-fde7d79936e2 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:24.584574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1c6a1-8962-40bb-8d63-fde7d79936e2 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:24.584574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1c6a1-8962-40bb-8d63-fde7d79936e2 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:24.586360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 716/1440] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:24.592942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c754d-5d91-403f-b0db-68ddf52f008e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:24.593459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c754d-5d91-403f-b0db-68ddf52f008e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:24.593566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c754d-5d91-403f-b0db-68ddf52f008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:24.611881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a17c754d-5d91-403f-b0db-68ddf52f008e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:24.613484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a17c754d-5d91-403f-b0db-68ddf52f008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:24.625197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 725/1441] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:24.669686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1c6a1-8962-40bb-8d63-fde7d79936e2 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:24.681402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1c6a1-8962-40bb-8d63-fde7d79936e2 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:24.684953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8f16-59a9-43b3-b94b-86be2aa21104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:24.685581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8f16-59a9-43b3-b94b-86be2aa21104 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:24.685862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8f16-59a9-43b3-b94b-86be2aa21104 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:24.686137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8f16-59a9-43b3-b94b-86be2aa21104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:24.695564 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8f16-59a9-43b3-b94b-86be2aa21104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:24.696986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8f16-59a9-43b3-b94b-86be2aa21104 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:24.706203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 717/1442] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:27.060267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa689-f75f-4f88-9b92-28233ae71a27 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:27.060835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa689-f75f-4f88-9b92-28233ae71a27 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:27.060835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fa689-f75f-4f88-9b92-28233ae71a27 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:27.062486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 726/1443] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:27.069032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a692-74fd-4f45-bf02-3dc51547ae2e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:27.069553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a692-74fd-4f45-bf02-3dc51547ae2e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:27.069644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a692-74fd-4f45-bf02-3dc51547ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:27.087523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-bb38a692-74fd-4f45-bf02-3dc51547ae2e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:27.088724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bb38a692-74fd-4f45-bf02-3dc51547ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:27.097008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 718/1444] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:27.138742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fa689-f75f-4f88-9b92-28233ae71a27 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:27.149851 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fa689-f75f-4f88-9b92-28233ae71a27 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:27.153525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cef30-b4ba-44c8-9db3-09c9c65e335b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:27.154186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cef30-b4ba-44c8-9db3-09c9c65e335b service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:27.154466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cef30-b4ba-44c8-9db3-09c9c65e335b service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:27.154778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cef30-b4ba-44c8-9db3-09c9c65e335b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:27.165315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cef30-b4ba-44c8-9db3-09c9c65e335b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:27.166859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cef30-b4ba-44c8-9db3-09c9c65e335b service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:27.177993 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 727/1445] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:29.575923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885c8d-2317-4fdc-bc4f-df3819b4ec9b None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:29.576486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885c8d-2317-4fdc-bc4f-df3819b4ec9b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:29.576486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885c8d-2317-4fdc-bc4f-df3819b4ec9b None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:29.578355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 719/1446] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:29.585523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7c13-4699-48a8-ae25-1513270ea583 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:29.586038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7c13-4699-48a8-ae25-1513270ea583 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:29.586038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a7c13-4699-48a8-ae25-1513270ea583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:29.603612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0c7a7c13-4699-48a8-ae25-1513270ea583 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:29.604830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0c7a7c13-4699-48a8-ae25-1513270ea583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:29.612847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 728/1447] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:29.653329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0885c8d-2317-4fdc-bc4f-df3819b4ec9b None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:29.663671 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0885c8d-2317-4fdc-bc4f-df3819b4ec9b None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:29.667091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970e8ae-72e1-4a29-8355-476bc5d7dad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:29.667718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970e8ae-72e1-4a29-8355-476bc5d7dad1 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:29.667998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970e8ae-72e1-4a29-8355-476bc5d7dad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:29.668268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970e8ae-72e1-4a29-8355-476bc5d7dad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:29.677375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970e8ae-72e1-4a29-8355-476bc5d7dad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:29.678850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970e8ae-72e1-4a29-8355-476bc5d7dad1 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:29.687935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 720/1448] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:32.089459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be30006-4de9-46bd-88db-c9b7ac795d4e None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:32.090135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be30006-4de9-46bd-88db-c9b7ac795d4e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:32.090135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be30006-4de9-46bd-88db-c9b7ac795d4e None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:32.091843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 729/1449] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:32.098038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab7e7-dd4a-4f72-acb1-8d4a20809ea3 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:32.098464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab7e7-dd4a-4f72-acb1-8d4a20809ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:32.098609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ab7e7-dd4a-4f72-acb1-8d4a20809ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:32.117291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3e9ab7e7-dd4a-4f72-acb1-8d4a20809ea3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:32.118483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3e9ab7e7-dd4a-4f72-acb1-8d4a20809ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:32.126691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 721/1450] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:32.167047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be30006-4de9-46bd-88db-c9b7ac795d4e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:32.178195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be30006-4de9-46bd-88db-c9b7ac795d4e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:32.181804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4fd68-1607-477a-ad46-6a0d8893d854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:32.182462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fd68-1607-477a-ad46-6a0d8893d854 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:32.182780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fd68-1607-477a-ad46-6a0d8893d854 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:32.183059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4fd68-1607-477a-ad46-6a0d8893d854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:32.192678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4fd68-1607-477a-ad46-6a0d8893d854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:32.194100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4fd68-1607-477a-ad46-6a0d8893d854 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:32.203359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 730/1451] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:34.533609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe88c3-d40f-4552-a794-4fafe99f2fe3 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:34.534143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe88c3-d40f-4552-a794-4fafe99f2fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:34.534143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe88c3-d40f-4552-a794-4fafe99f2fe3 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:34.535931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 722/1452] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:34.542003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee45b76-91f6-43f2-95b8-54c64c2ae10a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:34.542467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee45b76-91f6-43f2-95b8-54c64c2ae10a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:34.542587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee45b76-91f6-43f2-95b8-54c64c2ae10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:34.560577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4ee45b76-91f6-43f2-95b8-54c64c2ae10a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:34.561775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4ee45b76-91f6-43f2-95b8-54c64c2ae10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:34.570128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 731/1453] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:34.610977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe88c3-d40f-4552-a794-4fafe99f2fe3 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:34.621580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe88c3-d40f-4552-a794-4fafe99f2fe3 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:34.625120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe150a-def0-4c08-b0d1-4433b4d77e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:34.625774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe150a-def0-4c08-b0d1-4433b4d77e67 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:34.626061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe150a-def0-4c08-b0d1-4433b4d77e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:34.626339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe150a-def0-4c08-b0d1-4433b4d77e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:34.635769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe150a-def0-4c08-b0d1-4433b4d77e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:34.637211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe150a-def0-4c08-b0d1-4433b4d77e67 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:34.646659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 723/1454] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:36.974163 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5640-981a-4f6a-b88d-410ddbc3fc53 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:36.974806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5640-981a-4f6a-b88d-410ddbc3fc53 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:36.974806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5640-981a-4f6a-b88d-410ddbc3fc53 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:36.976564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 732/1455] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:36.983784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6220-4f70-4049-8602-a26b2cbec07d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:36.984367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6220-4f70-4049-8602-a26b2cbec07d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:36.984367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6220-4f70-4049-8602-a26b2cbec07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:37.005121 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-fd5c6220-4f70-4049-8602-a26b2cbec07d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:37.006356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fd5c6220-4f70-4049-8602-a26b2cbec07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:37.014288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 724/1456] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:37.054520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f5640-981a-4f6a-b88d-410ddbc3fc53 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:37.065108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f5640-981a-4f6a-b88d-410ddbc3fc53 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:37.068730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f88219-d9a0-42e0-8edb-2aafb9e8a1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:37.069361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f88219-d9a0-42e0-8edb-2aafb9e8a1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:37.069641 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f88219-d9a0-42e0-8edb-2aafb9e8a1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:37.069917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f88219-d9a0-42e0-8edb-2aafb9e8a1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:37.078890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f88219-d9a0-42e0-8edb-2aafb9e8a1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:37.080323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f88219-d9a0-42e0-8edb-2aafb9e8a1a9 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:37.089787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 733/1457] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:54.730878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff42b48-a145-40f5-8ca5-c31b3300c521 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:54.731482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff42b48-a145-40f5-8ca5-c31b3300c521 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:54.731482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff42b48-a145-40f5-8ca5-c31b3300c521 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:54.733411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 725/1458] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:54.741048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a306-07dd-4659-8740-9c0230b6c83a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:54.741506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a306-07dd-4659-8740-9c0230b6c83a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:54.741610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a306-07dd-4659-8740-9c0230b6c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:54.759728 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9e60a306-07dd-4659-8740-9c0230b6c83a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:54.760894 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9e60a306-07dd-4659-8740-9c0230b6c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:54.769011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 734/1459] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:54.820217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90020-3574-4dce-ab31-bbef5f4bdd70 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:54.820496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90020-3574-4dce-ab31-bbef5f4bdd70 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:54.820764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90020-3574-4dce-ab31-bbef5f4bdd70 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:54.822531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 726/1460] 10.222.0.16 () {54 vars in 962 bytes} [Thu Nov 11 17:08:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:54.827909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78684-184a-49de-89c8-dfa98d3d7dad None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:54.828197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78684-184a-49de-89c8-dfa98d3d7dad None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:54.828518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78684-184a-49de-89c8-dfa98d3d7dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:54.847258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-5cd78684-184a-49de-89c8-dfa98d3d7dad None None] MFA Rules not processed for user `8a061423c1f646b8892d646979f84f20`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:54.848450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5cd78684-184a-49de-89c8-dfa98d3d7dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:54.854868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 735/1461] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Nov 11 17:08:54 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:54.863526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90020-3574-4dce-ab31-bbef5f4bdd70 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:54.873658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90020-3574-4dce-ab31-bbef5f4bdd70 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:54.877759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6cfdb-84d4-4748-a879-8f6e2cf6c072 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a061423c1f646b8892d646979f84f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:54.878387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6cfdb-84d4-4748-a879-8f6e2cf6c072 service glance] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:54.878695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6cfdb-84d4-4748-a879-8f6e2cf6c072 service glance] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:54.878969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6cfdb-84d4-4748-a879-8f6e2cf6c072 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:54.887856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6cfdb-84d4-4748-a879-8f6e2cf6c072 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:54.889300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6cfdb-84d4-4748-a879-8f6e2cf6c072 service glance] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:54.899097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 727/1462] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:08:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:08:57.475116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3dbf-eb29-434d-8b45-db82d1cf132f None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:57.475637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3dbf-eb29-434d-8b45-db82d1cf132f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:57.475637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3dbf-eb29-434d-8b45-db82d1cf132f None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:57.477426 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 736/1463] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:08:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:08:57.484333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692b3a-a3eb-4cb7-b9d5-18885cad7d52 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:57.484827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692b3a-a3eb-4cb7-b9d5-18885cad7d52 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:57.484929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e692b3a-a3eb-4cb7-b9d5-18885cad7d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:57.503526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1e692b3a-a3eb-4cb7-b9d5-18885cad7d52 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:08:57.504712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1e692b3a-a3eb-4cb7-b9d5-18885cad7d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:08:57.512488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 728/1464] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:08:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:08:57.539178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc3dbf-eb29-434d-8b45-db82d1cf132f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:08:57.552339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc3dbf-eb29-434d-8b45-db82d1cf132f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:08:57.556963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e4455-e3f2-4c01-878d-fddb4a56f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:08:57.557636 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e4455-e3f2-4c01-878d-fddb4a56f543 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:08:57.557914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e4455-e3f2-4c01-878d-fddb4a56f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:08:57.558209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e4455-e3f2-4c01-878d-fddb4a56f543 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:08:57.558983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e4455-e3f2-4c01-878d-fddb4a56f543 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:08:57.560839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e4455-e3f2-4c01-878d-fddb4a56f543 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:08:57.580624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 737/1465] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Nov 11 17:08:57 2021] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:09:00.028483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05041e89-16fb-4826-8db6-004845b706db None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:00.029061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05041e89-16fb-4826-8db6-004845b706db None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:00.029061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05041e89-16fb-4826-8db6-004845b706db None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:00.031427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 729/1466] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:09:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:09:00.037567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca929-f298-4461-8a71-cd0b3df54acc None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:00.038030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca929-f298-4461-8a71-cd0b3df54acc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:00.038140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca929-f298-4461-8a71-cd0b3df54acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:00.060198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-706ca929-f298-4461-8a71-cd0b3df54acc None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:09:00.061381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-706ca929-f298-4461-8a71-cd0b3df54acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:09:00.069690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 738/1467] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:09:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:09:00.117608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05041e89-16fb-4826-8db6-004845b706db None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:09:00.132139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05041e89-16fb-4826-8db6-004845b706db None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:09:00.137477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b04e12-4dad-4545-98ae-5b4ce871ea3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:09:00.138115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04e12-4dad-4545-98ae-5b4ce871ea3f service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:00.138393 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04e12-4dad-4545-98ae-5b4ce871ea3f service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:00.138697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04e12-4dad-4545-98ae-5b4ce871ea3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:00.148043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b04e12-4dad-4545-98ae-5b4ce871ea3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:09:00.149649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b04e12-4dad-4545-98ae-5b4ce871ea3f service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:09:00.160447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 730/1468] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:09:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:09:02.704384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06fcd-92c0-42ac-89eb-ec528d40145c None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:02.705000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06fcd-92c0-42ac-89eb-ec528d40145c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:02.705000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06fcd-92c0-42ac-89eb-ec528d40145c None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:02.706698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 739/1469] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:09:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:09:02.712634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c0dc-d742-4183-b7eb-9f8c07a42240 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:02.713046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c0dc-d742-4183-b7eb-9f8c07a42240 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:02.713177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c0dc-d742-4183-b7eb-9f8c07a42240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:02.731793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-39e9c0dc-d742-4183-b7eb-9f8c07a42240 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:09:02.732979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-39e9c0dc-d742-4183-b7eb-9f8c07a42240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:09:02.740666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 731/1470] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:09:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:09:02.779263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06fcd-92c0-42ac-89eb-ec528d40145c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:09:02.790114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06fcd-92c0-42ac-89eb-ec528d40145c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:09:02.793569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f542dd-eb91-47f2-954f-a67c9ead43db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:09:02.794185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f542dd-eb91-47f2-954f-a67c9ead43db service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:02.794459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f542dd-eb91-47f2-954f-a67c9ead43db service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:02.794760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f542dd-eb91-47f2-954f-a67c9ead43db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:02.803410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f542dd-eb91-47f2-954f-a67c9ead43db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:09:02.804816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f542dd-eb91-47f2-954f-a67c9ead43db service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:09:02.813740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 740/1471] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:09:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:09:05.216720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64331be-08d6-41d4-9ef2-07da59287995 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:05.217369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64331be-08d6-41d4-9ef2-07da59287995 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:05.217369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64331be-08d6-41d4-9ef2-07da59287995 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:05.219771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 732/1472] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:09:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:09:05.226490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d83b2-8496-4e35-90ec-ae93212d751d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:05.227003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d83b2-8496-4e35-90ec-ae93212d751d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:05.227097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d83b2-8496-4e35-90ec-ae93212d751d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:05.245767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9e9d83b2-8496-4e35-90ec-ae93212d751d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:09:05.247028 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9e9d83b2-8496-4e35-90ec-ae93212d751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:09:05.254992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 741/1473] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:09:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:09:05.296458 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64331be-08d6-41d4-9ef2-07da59287995 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:09:05.306901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64331be-08d6-41d4-9ef2-07da59287995 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:09:05.310322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd8687-2a80-44ca-a941-38636a25e4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:09:05.310991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8687-2a80-44ca-a941-38636a25e4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:05.311270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8687-2a80-44ca-a941-38636a25e4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:05.312037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8687-2a80-44ca-a941-38636a25e4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:05.320790 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd8687-2a80-44ca-a941-38636a25e4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:09:05.322223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd8687-2a80-44ca-a941-38636a25e4c5 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:09:05.332082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 733/1474] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:09:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:09:07.825883 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409c8e-2c3b-41d6-adaa-50e44a229ab1 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:07.826452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409c8e-2c3b-41d6-adaa-50e44a229ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:07.826452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a409c8e-2c3b-41d6-adaa-50e44a229ab1 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:07.828871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 742/1475] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:09:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:09:07.834978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ebf3-79af-4581-9815-053f7639c381 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:07.835430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ebf3-79af-4581-9815-053f7639c381 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:07.835538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ebf3-79af-4581-9815-053f7639c381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:07.852902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a4d4ebf3-79af-4581-9815-053f7639c381 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:09:07.854093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a4d4ebf3-79af-4581-9815-053f7639c381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:09:07.862151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 734/1476] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:09:07.907478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a409c8e-2c3b-41d6-adaa-50e44a229ab1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:09:07.918006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a409c8e-2c3b-41d6-adaa-50e44a229ab1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:09:07.922000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a079b-8291-4535-822e-839d44abee7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:09:07.922658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a079b-8291-4535-822e-839d44abee7f service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:07.922946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a079b-8291-4535-822e-839d44abee7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:07.923213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a079b-8291-4535-822e-839d44abee7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:07.932027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a079b-8291-4535-822e-839d44abee7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:09:07.933449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a079b-8291-4535-822e-839d44abee7f service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:09:07.943131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 743/1477] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:09:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:09:10.604351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfe2be-f59d-41c7-9bbd-7e5259b92b9b None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:10.605016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfe2be-f59d-41c7-9bbd-7e5259b92b9b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:10.605016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfe2be-f59d-41c7-9bbd-7e5259b92b9b None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:10.607162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 735/1478] 10.222.0.16 () {54 vars in 926 bytes} [Thu Nov 11 17:09:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:09:10.614490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332bb4d-f0e6-49cc-ab93-52dc533564b3 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:10.615016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332bb4d-f0e6-49cc-ab93-52dc533564b3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:10.615134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332bb4d-f0e6-49cc-ab93-52dc533564b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:10.634726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-5332bb4d-f0e6-49cc-ab93-52dc533564b3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:09:10.644477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5332bb4d-f0e6-49cc-ab93-52dc533564b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:09:10.644928 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 744/1479] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Nov 11 17:09:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:09:10.689015 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfe2be-f59d-41c7-9bbd-7e5259b92b9b None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:09:10.700131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfe2be-f59d-41c7-9bbd-7e5259b92b9b None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:09:10.703717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bed811-96cb-488a-87b5-38134e316391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:09:10.704366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed811-96cb-488a-87b5-38134e316391 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:09:10.704664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed811-96cb-488a-87b5-38134e316391 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:09:10.704932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed811-96cb-488a-87b5-38134e316391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:09:10.714531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bed811-96cb-488a-87b5-38134e316391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:09:10.715991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bed811-96cb-488a-87b5-38134e316391 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:09:10.726307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 736/1480] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:09:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:10:35.480550 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0aee-cc95-485d-8939-1d9dd4b82b20 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:35.481123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0aee-cc95-485d-8939-1d9dd4b82b20 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:35.481123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0aee-cc95-485d-8939-1d9dd4b82b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:35.499417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2cde0aee-cc95-485d-8939-1d9dd4b82b20 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:10:35.513733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2cde0aee-cc95-485d-8939-1d9dd4b82b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:10:35.513733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 745/1481] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:10:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:10:35.518084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26cc8-52f9-4ce6-b48e-b4e7fe3a20ac None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:35.518688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26cc8-52f9-4ce6-b48e-b4e7fe3a20ac None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:35.518688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26cc8-52f9-4ce6-b48e-b4e7fe3a20ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:35.536344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-cde26cc8-52f9-4ce6-b48e-b4e7fe3a20ac None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:10:35.537516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-cde26cc8-52f9-4ce6-b48e-b4e7fe3a20ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:10:35.545582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 737/1482] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:10:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:10:35.550160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde0aee-cc95-485d-8939-1d9dd4b82b20 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:35.560501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde0aee-cc95-485d-8939-1d9dd4b82b20 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:35.565053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:35.565702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:35.565984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:35.566252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:35.567037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:10:35.567338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:35.568910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:35.581167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 746/1483] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:10:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:10:35.589150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26cc8-52f9-4ce6-b48e-b4e7fe3a20ac None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:35.598558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26cc8-52f9-4ce6-b48e-b4e7fe3a20ac None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:35.603454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58d6b3-c1f7-4cdf-be9b-7b64da74bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:35.604099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58d6b3-c1f7-4cdf-be9b-7b64da74bd7e admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:35.604380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58d6b3-c1f7-4cdf-be9b-7b64da74bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:35.604660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58d6b3-c1f7-4cdf-be9b-7b64da74bd7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:35.605372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58d6b3-c1f7-4cdf-be9b-7b64da74bd7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:35.607784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58d6b3-c1f7-4cdf-be9b-7b64da74bd7e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:35.695746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 738/1484] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:10:35 2021] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:10:35.700043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:35.709714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3731f1-5037-4b34-85fd-0b81e415c603 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:35.762487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a766d4-0193-4b3b-a376-e3dfab7eab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:35.763075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a766d4-0193-4b3b-a376-e3dfab7eab42 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:35.763349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a766d4-0193-4b3b-a376-e3dfab7eab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:35.763615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a766d4-0193-4b3b-a376-e3dfab7eab42 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:35.764303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a766d4-0193-4b3b-a376-e3dfab7eab42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:35.766183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a766d4-0193-4b3b-a376-e3dfab7eab42 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:35.856374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 747/1485] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:10:35 2021] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:10:35.861892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58d6b3-c1f7-4cdf-be9b-7b64da74bd7e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:35.873057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58d6b3-c1f7-4cdf-be9b-7b64da74bd7e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:35.877498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1819eb0-7b85-4ef9-8c4b-d07190564773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:35.878202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819eb0-7b85-4ef9-8c4b-d07190564773 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:35.878465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819eb0-7b85-4ef9-8c4b-d07190564773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:35.878766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1819eb0-7b85-4ef9-8c4b-d07190564773 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:35.879532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1819eb0-7b85-4ef9-8c4b-d07190564773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:35.881118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1819eb0-7b85-4ef9-8c4b-d07190564773 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:35.893924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 739/1486] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:10:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:10:35.897854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a766d4-0193-4b3b-a376-e3dfab7eab42 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:35.907542 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a766d4-0193-4b3b-a376-e3dfab7eab42 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:35.912296 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df806c0-6243-48ee-9a89-8056e0dc0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:35.912945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df806c0-6243-48ee-9a89-8056e0dc0efa admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:35.913221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df806c0-6243-48ee-9a89-8056e0dc0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:35.913490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df806c0-6243-48ee-9a89-8056e0dc0efa admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:35.914237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df806c0-6243-48ee-9a89-8056e0dc0efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:35.915849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df806c0-6243-48ee-9a89-8056e0dc0efa admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:35.930044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 748/1487] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:10:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:10:35.934848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1819eb0-7b85-4ef9-8c4b-d07190564773 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:35.944373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1819eb0-7b85-4ef9-8c4b-d07190564773 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:35.948785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c3c8e-d507-4239-a27c-6794694aae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:35.949692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3c8e-d507-4239-a27c-6794694aae26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:35.950018 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3c8e-d507-4239-a27c-6794694aae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:35.950291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c3c8e-d507-4239-a27c-6794694aae26 admin admin] PATH_INFO: `/v3/projects/2a186b82f0c54ad28a4180830dee0d73/users/f8f658eef0224c7588f0778e4cf8cfe3/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:35.964207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c3c8e-d507-4239-a27c-6794694aae26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a186b82f0c54ad28a4180830dee0d73, user_id=f8f658eef0224c7588f0778e4cf8cfe3, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:35.967386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c3c8e-d507-4239-a27c-6794694aae26 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:36.034067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 740/1488] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:10:35 2021] PUT /identity/v3/projects/2a186b82f0c54ad28a4180830dee0d73/users/f8f658eef0224c7588f0778e4cf8cfe3/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:10:36.045784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6cf0-59d5-4d82-8d67-6e492e2f0be2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:36.046074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6cf0-59d5-4d82-8d67-6e492e2f0be2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:36.046349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6cf0-59d5-4d82-8d67-6e492e2f0be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:36.071417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-420f6cf0-59d5-4d82-8d67-6e492e2f0be2 None None] MFA Rules not processed for user `f8f658eef0224c7588f0778e4cf8cfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:10:36.072611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-420f6cf0-59d5-4d82-8d67-6e492e2f0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:10:36.134428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 749/1489] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:10:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:10:36.145574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c3c8e-d507-4239-a27c-6794694aae26 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:36.216053 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c3c8e-d507-4239-a27c-6794694aae26 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:36.221425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0f3a9-b3c3-4f2e-80c8-3b85759d410d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:36.222059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0f3a9-b3c3-4f2e-80c8-3b85759d410d service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:36.222337 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0f3a9-b3c3-4f2e-80c8-3b85759d410d service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:36.222642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0f3a9-b3c3-4f2e-80c8-3b85759d410d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:36.230383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0f3a9-b3c3-4f2e-80c8-3b85759d410d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:36.232719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0f3a9-b3c3-4f2e-80c8-3b85759d410d service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:36.241351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 741/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:10:36 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:10:36.308998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffab4a-4098-45c2-bcb4-fa9a2089013b None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:36.309279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffab4a-4098-45c2-bcb4-fa9a2089013b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:36.309550 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffab4a-4098-45c2-bcb4-fa9a2089013b None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:36.311295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 750/1491] 10.222.0.16 () {52 vars in 829 bytes} [Thu Nov 11 17:10:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:10:36.314935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0f3a9-b3c3-4f2e-80c8-3b85759d410d service nova] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:36.374052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0f3a9-b3c3-4f2e-80c8-3b85759d410d service nova] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:36.378560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:36.379539 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:36.379818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:36.380095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] PATH_INFO: `/v3/users/f8f658eef0224c7588f0778e4cf8cfe3` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:36.381282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f658eef0224c7588f0778e4cf8cfe3)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:36.382292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 17:10:36.382292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 17:10:36.382292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 17:10:36.383535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:36.617232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f658eef0224c7588f0778e4cf8cfe3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:36.617893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f658eef0224c7588f0778e4cf8cfe3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:36.618523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f658eef0224c7588f0778e4cf8cfe3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:36.712241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f658eef0224c7588f0778e4cf8cfe3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:36.735156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f658eef0224c7588f0778e4cf8cfe3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:36.752255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 742/1492] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:10:36 2021] DELETE /identity/v3/users/f8f658eef0224c7588f0778e4cf8cfe3 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:10:36.756717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ed44e-42a9-4df1-b8cd-62c6926c0767 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:36.757216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ed44e-42a9-4df1-b8cd-62c6926c0767 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:36.757328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ed44e-42a9-4df1-b8cd-62c6926c0767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:36.774842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-228ed44e-42a9-4df1-b8cd-62c6926c0767 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:10:36.775999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-228ed44e-42a9-4df1-b8cd-62c6926c0767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:10:36.831215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 751/1493] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:10:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:10:36.841648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:36.843714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:10:36.900551 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc3c9-fe44-4fa3-b61b-08763ddde028 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:36.906737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069cd59-5997-4d1c-bc6f-5192604adfee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:36.906737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069cd59-5997-4d1c-bc6f-5192604adfee service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:36.906737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069cd59-5997-4d1c-bc6f-5192604adfee service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:36.906737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069cd59-5997-4d1c-bc6f-5192604adfee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:36.914265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069cd59-5997-4d1c-bc6f-5192604adfee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:36.915708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069cd59-5997-4d1c-bc6f-5192604adfee service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:36.924899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 743/1494] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:10:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:10:37.459497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ed44e-42a9-4df1-b8cd-62c6926c0767 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:10:37.461575 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-228ed44e-42a9-4df1-b8cd-62c6926c0767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:10:37.479294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ed44e-42a9-4df1-b8cd-62c6926c0767 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:10:37.484096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:10:37.484855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:10:37.485133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:10:37.485412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] PATH_INFO: `/v3/projects/2a186b82f0c54ad28a4180830dee0d73` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:10:37.486798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a186b82f0c54ad28a4180830dee0d73)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:10:37.487799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 17:10:37.487799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 17:10:37.487799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 17:10:37.489017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:10:37.609551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a186b82f0c54ad28a4180830dee0d73', 'request_id': 'req-b7217279-1563-41bc-8c38-d51cdfd19f9a'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:37.701803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a186b82f0c54ad28a4180830dee0d73', 'request_id': 'req-b7217279-1563-41bc-8c38-d51cdfd19f9a'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:37.708093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a186b82f0c54ad28a4180830dee0d73', 'request_id': 'req-b7217279-1563-41bc-8c38-d51cdfd19f9a'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:37.726219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] The token cache is being invalidate because project 2a186b82f0c54ad28a4180830dee0d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:10:37.726501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:37.727170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b7217279-1563-41bc-8c38-d51cdfd19f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:10:37.728766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 752/1495] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:10:37 2021] DELETE /identity/v3/projects/2a186b82f0c54ad28a4180830dee0d73 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:12:10.948589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd95fc-77a9-45d2-ac7a-f6c015916680 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:10.949127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd95fc-77a9-45d2-ac7a-f6c015916680 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:10.949127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd95fc-77a9-45d2-ac7a-f6c015916680 None None] PATH_INFO: `/v3` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:10.950430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 744/1496] 10.222.0.10 () {54 vars in 925 bytes} [Thu Nov 11 17:12:10 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:12:10.959252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791b305-b326-4492-b7da-5fa22da6208e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:10.959669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791b305-b326-4492-b7da-5fa22da6208e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:10.959823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791b305-b326-4492-b7da-5fa22da6208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:10.982505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c791b305-b326-4492-b7da-5fa22da6208e None None] MFA Rules not processed for user `db055fddc41c4eb0ba1c3b410e1e8e03`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:10.983984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c791b305-b326-4492-b7da-5fa22da6208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:11.049480 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 753/1497] 10.222.0.10 () {58 vars in 1015 bytes} [Thu Nov 11 17:12:10 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:11.146664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b06ee3-1373-4ded-bc9b-5b2fb740a2c5 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:11.147005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b06ee3-1373-4ded-bc9b-5b2fb740a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:11.147579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b06ee3-1373-4ded-bc9b-5b2fb740a2c5 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:11.149043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 745/1498] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 11 17:12:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:11.154507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a829eb-9d22-4c35-93cd-a9c348b1a0a0 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:11.154822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a829eb-9d22-4c35-93cd-a9c348b1a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:11.155097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a829eb-9d22-4c35-93cd-a9c348b1a0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:11.173010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c1a829eb-9d22-4c35-93cd-a9c348b1a0a0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:11.174160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c1a829eb-9d22-4c35-93cd-a9c348b1a0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:11.229959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 754/1499] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 11 17:12:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:11.386944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b06ee3-1373-4ded-bc9b-5b2fb740a2c5 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:11.388712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-56b06ee3-1373-4ded-bc9b-5b2fb740a2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:11.461142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b06ee3-1373-4ded-bc9b-5b2fb740a2c5 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:11.466443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651eff-d460-4704-8652-66fd65a56f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:11.467107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651eff-d460-4704-8652-66fd65a56f92 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:11.467384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651eff-d460-4704-8652-66fd65a56f92 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:11.467656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651eff-d460-4704-8652-66fd65a56f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:11.475436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651eff-d460-4704-8652-66fd65a56f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:11.477264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651eff-d460-4704-8652-66fd65a56f92 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:11.486334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 746/1500] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:12:12.926010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853e427-bd85-44db-80df-d84249e3e70b None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:12.926450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853e427-bd85-44db-80df-d84249e3e70b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:12.926584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853e427-bd85-44db-80df-d84249e3e70b None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:12.928924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 755/1501] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 11 17:12:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:12:12.934268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe563c8-b79a-4bf7-b50f-2abad7e5b9bc None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:12.934711 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe563c8-b79a-4bf7-b50f-2abad7e5b9bc None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:12.934857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe563c8-b79a-4bf7-b50f-2abad7e5b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:12.954687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-abe563c8-b79a-4bf7-b50f-2abad7e5b9bc None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:12.955925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-abe563c8-b79a-4bf7-b50f-2abad7e5b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:12.963936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 747/1502] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 11 17:12:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:13.126146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853e427-bd85-44db-80df-d84249e3e70b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:13.141194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853e427-bd85-44db-80df-d84249e3e70b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:13.146798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c026fd7-e7cd-4877-b154-2f81a9542a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:13.147432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c026fd7-e7cd-4877-b154-2f81a9542a15 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:13.147703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c026fd7-e7cd-4877-b154-2f81a9542a15 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:13.147974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c026fd7-e7cd-4877-b154-2f81a9542a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:13.156823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c026fd7-e7cd-4877-b154-2f81a9542a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:13.158530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c026fd7-e7cd-4877-b154-2f81a9542a15 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:13.168580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 756/1503] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:12:15.042804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb78e4-870b-4e1a-9194-7c8005da698b None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:15.043421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb78e4-870b-4e1a-9194-7c8005da698b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:15.043421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb78e4-870b-4e1a-9194-7c8005da698b None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:15.045132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 748/1504] 10.222.0.16 () {54 vars in 960 bytes} [Thu Nov 11 17:12:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:15.050395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bad8-17d2-429d-86e5-5e9b1c350a8c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:15.055422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bad8-17d2-429d-86e5-5e9b1c350a8c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:15.055422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bad8-17d2-429d-86e5-5e9b1c350a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:15.069479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2a19bad8-17d2-429d-86e5-5e9b1c350a8c None None] MFA Rules not processed for user `db055fddc41c4eb0ba1c3b410e1e8e03`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:15.070708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2a19bad8-17d2-429d-86e5-5e9b1c350a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:15.079222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 757/1505] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Nov 11 17:12:15 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:15.087582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb78e4-870b-4e1a-9194-7c8005da698b None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:15.101036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb78e4-870b-4e1a-9194-7c8005da698b None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:15.106197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593bc67-2a27-4af1-81e5-0f104a81dcc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db055fddc41c4eb0ba1c3b410e1e8e03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:15.106867 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bc67-2a27-4af1-81e5-0f104a81dcc1 service placement] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:15.107150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bc67-2a27-4af1-81e5-0f104a81dcc1 service placement] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:15.107426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bc67-2a27-4af1-81e5-0f104a81dcc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:15.116602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593bc67-2a27-4af1-81e5-0f104a81dcc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:15.118181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593bc67-2a27-4af1-81e5-0f104a81dcc1 service placement] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:15.127660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 749/1506] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:12:25.024969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3a6f-4359-41a5-afd0-4116d7bc0fa9 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:25.025581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3a6f-4359-41a5-afd0-4116d7bc0fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:25.025581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3a6f-4359-41a5-afd0-4116d7bc0fa9 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:25.027333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 758/1507] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 11 17:12:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:25.032536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3369b07-c874-4315-b5b9-4969751d9bfa None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:25.032991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3369b07-c874-4315-b5b9-4969751d9bfa None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:25.033110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3369b07-c874-4315-b5b9-4969751d9bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:25.050826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c3369b07-c874-4315-b5b9-4969751d9bfa None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:25.051998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c3369b07-c874-4315-b5b9-4969751d9bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:25.060144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 750/1508] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 11 17:12:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:25.218788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da3a6f-4359-41a5-afd0-4116d7bc0fa9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:25.233261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da3a6f-4359-41a5-afd0-4116d7bc0fa9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:25.238410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b88a7d-d734-4bf9-9a53-03b2ab95d002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:25.239058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b88a7d-d734-4bf9-9a53-03b2ab95d002 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:25.239333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b88a7d-d734-4bf9-9a53-03b2ab95d002 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:25.239601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b88a7d-d734-4bf9-9a53-03b2ab95d002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:25.248128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b88a7d-d734-4bf9-9a53-03b2ab95d002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:25.249702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b88a7d-d734-4bf9-9a53-03b2ab95d002 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:25.258682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 759/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:12:26.714111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82fb3-b0ee-42b8-b6d9-55dc9cf02268 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:26.714678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82fb3-b0ee-42b8-b6d9-55dc9cf02268 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:26.714678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82fb3-b0ee-42b8-b6d9-55dc9cf02268 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:26.716471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 751/1510] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 11 17:12:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:26.722087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4dac-cda4-4f31-a7d9-6d397b6b9e74 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:26.722520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4dac-cda4-4f31-a7d9-6d397b6b9e74 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:26.722658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4dac-cda4-4f31-a7d9-6d397b6b9e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:26.740841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-65aa4dac-cda4-4f31-a7d9-6d397b6b9e74 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:26.742004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-65aa4dac-cda4-4f31-a7d9-6d397b6b9e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:26.750357 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 760/1511] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 11 17:12:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:12:26.905626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc82fb3-b0ee-42b8-b6d9-55dc9cf02268 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:26.920308 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc82fb3-b0ee-42b8-b6d9-55dc9cf02268 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:26.925722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f21be9-92a3-4eb8-9366-a309f4a1a8dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:26.926349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21be9-92a3-4eb8-9366-a309f4a1a8dd service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:26.926666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21be9-92a3-4eb8-9366-a309f4a1a8dd service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:26.926941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f21be9-92a3-4eb8-9366-a309f4a1a8dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:26.935974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f21be9-92a3-4eb8-9366-a309f4a1a8dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:26.937541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f21be9-92a3-4eb8-9366-a309f4a1a8dd service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:26.946684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 752/1512] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:12:31.353165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af064b-0cba-4c2f-90dd-ae5493facfef None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:31.353754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af064b-0cba-4c2f-90dd-ae5493facfef None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:31.353754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af064b-0cba-4c2f-90dd-ae5493facfef None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:31.355579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 761/1513] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 11 17:12:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:31.362871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772177-d9b2-43ba-84ea-d888b90f591a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:31.363334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772177-d9b2-43ba-84ea-d888b90f591a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:31.363447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08772177-d9b2-43ba-84ea-d888b90f591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:31.381762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-08772177-d9b2-43ba-84ea-d888b90f591a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:31.383007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-08772177-d9b2-43ba-84ea-d888b90f591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:31.390762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 753/1514] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 11 17:12:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:31.428999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af064b-0cba-4c2f-90dd-ae5493facfef None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:31.431408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-54af064b-0cba-4c2f-90dd-ae5493facfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:31.486772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af064b-0cba-4c2f-90dd-ae5493facfef None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:31.490238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7c42d-3701-4c39-a12f-c27634b16fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:31.490906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7c42d-3701-4c39-a12f-c27634b16fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:31.491231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7c42d-3701-4c39-a12f-c27634b16fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:31.491534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7c42d-3701-4c39-a12f-c27634b16fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:31.500969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7c42d-3701-4c39-a12f-c27634b16fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:31.502460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7c42d-3701-4c39-a12f-c27634b16fb1 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:31.511813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 762/1515] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:12:33.799226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6d83-b085-4e67-8645-7481516fb62d None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:33.799755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6d83-b085-4e67-8645-7481516fb62d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:33.799755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6d83-b085-4e67-8645-7481516fb62d None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:33.801511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 754/1516] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 11 17:12:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:33.807878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de60a0-44d7-4508-bdbd-592e42b5041a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:33.808317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de60a0-44d7-4508-bdbd-592e42b5041a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:33.808459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de60a0-44d7-4508-bdbd-592e42b5041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:33.826778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-77de60a0-44d7-4508-bdbd-592e42b5041a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:33.827985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-77de60a0-44d7-4508-bdbd-592e42b5041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:33.835702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 763/1517] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 11 17:12:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:33.875275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6d83-b085-4e67-8645-7481516fb62d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:33.885742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6d83-b085-4e67-8645-7481516fb62d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:33.889263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10841-ca32-4924-8fff-ef4d380d1d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:33.889880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10841-ca32-4924-8fff-ef4d380d1d6a service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:33.890156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10841-ca32-4924-8fff-ef4d380d1d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:33.890428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10841-ca32-4924-8fff-ef4d380d1d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:33.899579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10841-ca32-4924-8fff-ef4d380d1d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:33.901020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10841-ca32-4924-8fff-ef4d380d1d6a service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:33.910080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 755/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:12:37.779667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce5f6a-1725-4edf-9f55-3a609413f3fc None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:37.780271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce5f6a-1725-4edf-9f55-3a609413f3fc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:37.780271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce5f6a-1725-4edf-9f55-3a609413f3fc None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:37.781957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 764/1519] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 11 17:12:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:37.787640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f2e8-7b3a-4b86-b742-2fe7d4ba9aeb None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:37.788068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f2e8-7b3a-4b86-b742-2fe7d4ba9aeb None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:37.788175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f2e8-7b3a-4b86-b742-2fe7d4ba9aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:37.806039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d1a9f2e8-7b3a-4b86-b742-2fe7d4ba9aeb None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:37.807232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d1a9f2e8-7b3a-4b86-b742-2fe7d4ba9aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:37.814855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 756/1520] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 11 17:12:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:37.872554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce5f6a-1725-4edf-9f55-3a609413f3fc None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:37.874217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-fcce5f6a-1725-4edf-9f55-3a609413f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:37.930743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce5f6a-1725-4edf-9f55-3a609413f3fc None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:37.934655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39db0d-1959-4b6d-a5eb-ab9d2e1123b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:37.935300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39db0d-1959-4b6d-a5eb-ab9d2e1123b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:37.935574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39db0d-1959-4b6d-a5eb-ab9d2e1123b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:37.935845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39db0d-1959-4b6d-a5eb-ab9d2e1123b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:37.945087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39db0d-1959-4b6d-a5eb-ab9d2e1123b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:37.947174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39db0d-1959-4b6d-a5eb-ab9d2e1123b1 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:37.956579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 765/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:12:40.247896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6e41f-04b3-4251-8fcf-0191555ea027 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:40.248452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6e41f-04b3-4251-8fcf-0191555ea027 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:40.248452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6e41f-04b3-4251-8fcf-0191555ea027 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:40.250236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 11 17:12:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:40.256248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8dea-8fbb-449c-9a6a-2fab65897642 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:40.256741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8dea-8fbb-449c-9a6a-2fab65897642 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:40.256852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8dea-8fbb-449c-9a6a-2fab65897642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:40.274730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3f7a8dea-8fbb-449c-9a6a-2fab65897642 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:40.275904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3f7a8dea-8fbb-449c-9a6a-2fab65897642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:40.283566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 11 17:12:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:40.336191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e61d90-cc4f-4059-8741-21230bee02a8 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:40.336501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e61d90-cc4f-4059-8741-21230bee02a8 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:40.336776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e61d90-cc4f-4059-8741-21230bee02a8 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:40.338515 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 758/1524] 10.222.0.16 () {54 vars in 962 bytes} [Thu Nov 11 17:12:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:12:40.343961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599c16-692d-402f-9424-307189e54774 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:40.344245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599c16-692d-402f-9424-307189e54774 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:40.344522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599c16-692d-402f-9424-307189e54774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:40.363393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dd599c16-692d-402f-9424-307189e54774 None None] MFA Rules not processed for user `b88bc12e78894bdbaf79d148c3dd2e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:12:40.364635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dd599c16-692d-402f-9424-307189e54774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:12:40.371959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 767/1525] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Nov 11 17:12:40 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:12:40.379840 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e61d90-cc4f-4059-8741-21230bee02a8 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:12:40.390436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e61d90-cc4f-4059-8741-21230bee02a8 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:12:40.394152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1990-a506-4679-a980-7a8c29e3d1f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:12:40.394849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1990-a506-4679-a980-7a8c29e3d1f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:12:40.395226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1990-a506-4679-a980-7a8c29e3d1f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:12:40.395500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1990-a506-4679-a980-7a8c29e3d1f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:12:40.404628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b1990-a506-4679-a980-7a8c29e3d1f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:12:40.406091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b1990-a506-4679-a980-7a8c29e3d1f8 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:12:40.415764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 759/1526] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:12:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:04.591945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115457d-9732-495a-a244-10f5ecaa20b5 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.592548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115457d-9732-495a-a244-10f5ecaa20b5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.592548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115457d-9732-495a-a244-10f5ecaa20b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.616634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-6115457d-9732-495a-a244-10f5ecaa20b5 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.621068 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6115457d-9732-495a-a244-10f5ecaa20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:04.630939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 768/1527] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:04.640237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a24f-a6a5-42fe-bf98-dbcbd777ee01 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.640818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a24f-a6a5-42fe-bf98-dbcbd777ee01 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.640818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a24f-a6a5-42fe-bf98-dbcbd777ee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.668195 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-8f34a24f-a6a5-42fe-bf98-dbcbd777ee01 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.669386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8f34a24f-a6a5-42fe-bf98-dbcbd777ee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:04.679330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 760/1528] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:04.684374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115457d-9732-495a-a244-10f5ecaa20b5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:04.696563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115457d-9732-495a-a244-10f5ecaa20b5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:04.705933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:04.706627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.706910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.707186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.707997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:04.708305 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:04.709921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:04.724226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279a93-aa91-4309-9838-2985047a1d24 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.724452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279a93-aa91-4309-9838-2985047a1d24 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.724729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279a93-aa91-4309-9838-2985047a1d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.726688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 769/1529] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:04.736889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:04.749486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cad78-9b94-4188-8209-e420be5dfd6e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:04.758429 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb56d8e-9423-4bb0-b464-14f05fc0d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:04.758798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-fe279a93-aa91-4309-9838-2985047a1d24 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.759125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56d8e-9423-4bb0-b464-14f05fc0d18c admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.759408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56d8e-9423-4bb0-b464-14f05fc0d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.759737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56d8e-9423-4bb0-b464-14f05fc0d18c admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.760000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fe279a93-aa91-4309-9838-2985047a1d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:04.760487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb56d8e-9423-4bb0-b464-14f05fc0d18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:04.762531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb56d8e-9423-4bb0-b464-14f05fc0d18c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:04.780238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 761/1530] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:04.781376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287894d-775e-4ffa-b007-ca912bfe007d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.781653 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287894d-775e-4ffa-b007-ca912bfe007d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.781922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287894d-775e-4ffa-b007-ca912bfe007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.810651 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3287894d-775e-4ffa-b007-ca912bfe007d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.811890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3287894d-775e-4ffa-b007-ca912bfe007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:04.822286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 762/1531] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:04.823467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f682f-5a0a-4d56-bee5-5524fecaff6f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.823788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f682f-5a0a-4d56-bee5-5524fecaff6f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.824066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f682f-5a0a-4d56-bee5-5524fecaff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.845716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ed1f682f-5a0a-4d56-bee5-5524fecaff6f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.846710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ed1f682f-5a0a-4d56-bee5-5524fecaff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:04.855974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 763/1532] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:04.857298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404451ad-8090-49bc-a121-219af560e064 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.857584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404451ad-8090-49bc-a121-219af560e064 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.857861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404451ad-8090-49bc-a121-219af560e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.878951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-404451ad-8090-49bc-a121-219af560e064 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.880162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-404451ad-8090-49bc-a121-219af560e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:04.888309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 764/1533] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:04.889624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1494fd-4b17-42b4-b75b-cb839a09f221 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.889900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1494fd-4b17-42b4-b75b-cb839a09f221 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.890221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1494fd-4b17-42b4-b75b-cb839a09f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.906942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 770/1534] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:04.911457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610011be-9d51-43a9-9ff7-50c90813b886 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.911715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-dd1494fd-4b17-42b4-b75b-cb839a09f221 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.911838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610011be-9d51-43a9-9ff7-50c90813b886 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.912011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610011be-9d51-43a9-9ff7-50c90813b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.913059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-dd1494fd-4b17-42b4-b75b-cb839a09f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:04.931132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-610011be-9d51-43a9-9ff7-50c90813b886 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.932507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-610011be-9d51-43a9-9ff7-50c90813b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:04.976783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 765/1535] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:04.979066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c00cb9-efb7-4e1f-93fb-54b90ce18e6d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:04.979356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c00cb9-efb7-4e1f-93fb-54b90ce18e6d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:04.980021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c00cb9-efb7-4e1f-93fb-54b90ce18e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:04.996968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 771/1536] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:04.997905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610011be-9d51-43a9-9ff7-50c90813b886 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:04.998534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a5c00cb9-efb7-4e1f-93fb-54b90ce18e6d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:04.999830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a5c00cb9-efb7-4e1f-93fb-54b90ce18e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:05.007003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610011be-9d51-43a9-9ff7-50c90813b886 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.010076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 766/1537] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:05.011596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cf5a-c20a-4ced-8d74-5c9ca6526e2f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.011891 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cf5a-c20a-4ced-8d74-5c9ca6526e2f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.012169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cf5a-c20a-4ced-8d74-5c9ca6526e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.018077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c773037-5355-4d7b-a329-a86e162b884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.018890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c773037-5355-4d7b-a329-a86e162b884b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.019204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c773037-5355-4d7b-a329-a86e162b884b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.019498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c773037-5355-4d7b-a329-a86e162b884b admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.020228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c773037-5355-4d7b-a329-a86e162b884b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:05.020533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c773037-5355-4d7b-a329-a86e162b884b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.022128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c773037-5355-4d7b-a329-a86e162b884b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.030273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3878cf5a-c20a-4ced-8d74-5c9ca6526e2f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:05.031507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3878cf5a-c20a-4ced-8d74-5c9ca6526e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:05.034284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 772/1538] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:05.035782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76154210-673c-4661-8d8a-0bf5b0c06e91 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.036075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76154210-673c-4661-8d8a-0bf5b0c06e91 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.036348 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76154210-673c-4661-8d8a-0bf5b0c06e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.042584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 767/1539] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:05.042584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878cf5a-c20a-4ced-8d74-5c9ca6526e2f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.050411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878cf5a-c20a-4ced-8d74-5c9ca6526e2f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.055323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b641466-1546-47e4-a22d-5fe8baae94fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.055980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641466-1546-47e4-a22d-5fe8baae94fb admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.056254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641466-1546-47e4-a22d-5fe8baae94fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.056527 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b641466-1546-47e4-a22d-5fe8baae94fb admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.057249 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b641466-1546-47e4-a22d-5fe8baae94fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.057518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-76154210-673c-4661-8d8a-0bf5b0c06e91 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:05.058768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-76154210-673c-4661-8d8a-0bf5b0c06e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:05.059185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b641466-1546-47e4-a22d-5fe8baae94fb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.066774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 773/1540] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:05.067998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493081e5-68d4-4f4a-883f-24a9dfde90b0 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.068280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493081e5-68d4-4f4a-883f-24a9dfde90b0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.068553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493081e5-68d4-4f4a-883f-24a9dfde90b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.085769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-493081e5-68d4-4f4a-883f-24a9dfde90b0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:05.087521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-493081e5-68d4-4f4a-883f-24a9dfde90b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:05.095287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 774/1541] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:05.096083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493081e5-68d4-4f4a-883f-24a9dfde90b0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.106851 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493081e5-68d4-4f4a-883f-24a9dfde90b0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.114128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33718-e22d-4df0-9782-702f903fd537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.114828 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33718-e22d-4df0-9782-702f903fd537 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.115103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33718-e22d-4df0-9782-702f903fd537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.115377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33718-e22d-4df0-9782-702f903fd537 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.116101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33718-e22d-4df0-9782-702f903fd537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:05.116401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33718-e22d-4df0-9782-702f903fd537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.118624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33718-e22d-4df0-9782-702f903fd537 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.130190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 775/1542] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:05.131559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4715-d5c4-4bd6-8f87-4f2941ac5480 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.131890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4715-d5c4-4bd6-8f87-4f2941ac5480 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.132168 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4715-d5c4-4bd6-8f87-4f2941ac5480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.150793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-122b4715-d5c4-4bd6-8f87-4f2941ac5480 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:05.151991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-122b4715-d5c4-4bd6-8f87-4f2941ac5480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:05.160419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 776/1543] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:05.161460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3501-259b-456b-8b0e-eaba985be4ab None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.161734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3501-259b-456b-8b0e-eaba985be4ab None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.162004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3501-259b-456b-8b0e-eaba985be4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.181869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-02ff3501-259b-456b-8b0e-eaba985be4ab None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:05.183197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-02ff3501-259b-456b-8b0e-eaba985be4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:05.185992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 768/1544] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:05.187342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b641466-1546-47e4-a22d-5fe8baae94fb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.193709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 777/1545] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:05.195546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c39b3-f45d-4fef-8475-154a09e34733 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.196155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c39b3-f45d-4fef-8475-154a09e34733 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.196913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c39b3-f45d-4fef-8475-154a09e34733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.204166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b641466-1546-47e4-a22d-5fe8baae94fb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.211929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c0b81-3091-405f-a724-cc96f69ec409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.212911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0b81-3091-405f-a724-cc96f69ec409 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.213338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0b81-3091-405f-a724-cc96f69ec409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.213759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0b81-3091-405f-a724-cc96f69ec409 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.215593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c0b81-3091-405f-a724-cc96f69ec409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.216342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-501c39b3-f45d-4fef-8475-154a09e34733 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:05.217606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-501c39b3-f45d-4fef-8475-154a09e34733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:05.219342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c0b81-3091-405f-a724-cc96f69ec409 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.225675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 778/1546] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:05.226464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c39b3-f45d-4fef-8475-154a09e34733 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.236171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c39b3-f45d-4fef-8475-154a09e34733 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.240930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b37b6-b631-4350-a7dc-75965b0177e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.241957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b37b6-b631-4350-a7dc-75965b0177e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.243072 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b37b6-b631-4350-a7dc-75965b0177e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.243395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b37b6-b631-4350-a7dc-75965b0177e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.244827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b37b6-b631-4350-a7dc-75965b0177e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:05.246820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b37b6-b631-4350-a7dc-75965b0177e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.251715 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b37b6-b631-4350-a7dc-75965b0177e2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.265017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 779/1547] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:05.266387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916050e8-36b9-462f-9270-68b6db95ee1f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.266717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916050e8-36b9-462f-9270-68b6db95ee1f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.266995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916050e8-36b9-462f-9270-68b6db95ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.284686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-916050e8-36b9-462f-9270-68b6db95ee1f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:05.285874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-916050e8-36b9-462f-9270-68b6db95ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:05.294036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 780/1548] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:05.295356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916050e8-36b9-462f-9270-68b6db95ee1f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.306239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916050e8-36b9-462f-9270-68b6db95ee1f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.310913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455df5a-ee58-4b29-b7a0-d08f94acfee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.316008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455df5a-ee58-4b29-b7a0-d08f94acfee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.316008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455df5a-ee58-4b29-b7a0-d08f94acfee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.316008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455df5a-ee58-4b29-b7a0-d08f94acfee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.316302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 769/1549] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:05.316416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455df5a-ee58-4b29-b7a0-d08f94acfee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.316522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c0b81-3091-405f-a724-cc96f69ec409 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.316621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455df5a-ee58-4b29-b7a0-d08f94acfee5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.379316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c0b81-3091-405f-a724-cc96f69ec409 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.384553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.385205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.385483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.385753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.386476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:05.386808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.388425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.399840 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 770/1550] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:05.400678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.410058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a2aa3-9cc4-44c0-b2a6-0a277d15feff admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.415165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f14f-f04c-4428-9569-d1a0acab1ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.426574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f14f-f04c-4428-9569-d1a0acab1ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.426574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f14f-f04c-4428-9569-d1a0acab1ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.426574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f14f-f04c-4428-9569-d1a0acab1ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.426574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9f14f-f04c-4428-9569-d1a0acab1ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.426574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9f14f-f04c-4428-9569-d1a0acab1ac7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.429083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 771/1551] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:05.429861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f14f-f04c-4428-9569-d1a0acab1ac7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.439898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f14f-f04c-4428-9569-d1a0acab1ac7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.444394 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.445004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.445281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.445551 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.446282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:05.446624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.448176 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.458036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 781/1552] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:05.458036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455df5a-ee58-4b29-b7a0-d08f94acfee5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.460049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 772/1553] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:05.460964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.473823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c12a-e451-48b1-99aa-56ee954e6a88 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.519515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455df5a-ee58-4b29-b7a0-d08f94acfee5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.524605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.525342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.525626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.526019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.526019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:05.526019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.529048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.529636 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e203aea-ad17-4076-aa45-185f810a2262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.530386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203aea-ad17-4076-aa45-185f810a2262 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.530761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203aea-ad17-4076-aa45-185f810a2262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.531154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e203aea-ad17-4076-aa45-185f810a2262 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.531883 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e203aea-ad17-4076-aa45-185f810a2262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.533861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e203aea-ad17-4076-aa45-185f810a2262 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.541473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 782/1554] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:05.543550 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.559040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a36b57-1f21-4a9b-a84c-1c7bc72f9a4e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.563854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.564898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.564898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.565116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.565741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:05.566045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.567747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.579355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 783/1555] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:05.580247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.589518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e2720-7992-4158-89b8-33f0c7138671 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.594253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec747-8d5c-43c4-aea7-0e04ecb18dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.594951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec747-8d5c-43c4-aea7-0e04ecb18dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.595233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec747-8d5c-43c4-aea7-0e04ecb18dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.595509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec747-8d5c-43c4-aea7-0e04ecb18dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.596204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faec747-8d5c-43c4-aea7-0e04ecb18dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.598131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faec747-8d5c-43c4-aea7-0e04ecb18dd5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.626674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 773/1556] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/projects => generated 397 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:05.627463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e203aea-ad17-4076-aa45-185f810a2262 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.684107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e203aea-ad17-4076-aa45-185f810a2262 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.688849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c5fe-19a9-48fd-b6d2-14685a28fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.689503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c5fe-19a9-48fd-b6d2-14685a28fc26 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.689771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c5fe-19a9-48fd-b6d2-14685a28fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.690040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c5fe-19a9-48fd-b6d2-14685a28fc26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.690754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c5fe-19a9-48fd-b6d2-14685a28fc26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.692628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c5fe-19a9-48fd-b6d2-14685a28fc26 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.716569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 784/1557] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:05.717379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec747-8d5c-43c4-aea7-0e04ecb18dd5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.727454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec747-8d5c-43c4-aea7-0e04ecb18dd5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.732324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe73036-8d8c-4e08-b07f-0c3d0bbd204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.732982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73036-8d8c-4e08-b07f-0c3d0bbd204e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.733258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73036-8d8c-4e08-b07f-0c3d0bbd204e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.733527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73036-8d8c-4e08-b07f-0c3d0bbd204e admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.734240 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe73036-8d8c-4e08-b07f-0c3d0bbd204e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.735838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe73036-8d8c-4e08-b07f-0c3d0bbd204e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.745990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 785/1558] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:05.746767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe73036-8d8c-4e08-b07f-0c3d0bbd204e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.755821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe73036-8d8c-4e08-b07f-0c3d0bbd204e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.760936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c332ea-700e-41fc-ac81-de43207c9723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.761140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c332ea-700e-41fc-ac81-de43207c9723 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.761406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c332ea-700e-41fc-ac81-de43207c9723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.761679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c332ea-700e-41fc-ac81-de43207c9723 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.762363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c332ea-700e-41fc-ac81-de43207c9723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.764542 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c332ea-700e-41fc-ac81-de43207c9723 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.849440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 774/1559] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:05.850244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c5fe-19a9-48fd-b6d2-14685a28fc26 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.882260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 786/1560] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/users => generated 303 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:05.883392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c332ea-700e-41fc-ac81-de43207c9723 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:05.892556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c332ea-700e-41fc-ac81-de43207c9723 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.911964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c5fe-19a9-48fd-b6d2-14685a28fc26 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:05.917451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8f58-3b3b-4bd8-a703-00011ffb5d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.918105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8f58-3b3b-4bd8-a703-00011ffb5d98 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.918395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8f58-3b3b-4bd8-a703-00011ffb5d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.918725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8f58-3b3b-4bd8-a703-00011ffb5d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.919427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c8f58-3b3b-4bd8-a703-00011ffb5d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.921342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c8f58-3b3b-4bd8-a703-00011ffb5d98 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:05.948186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468cfe3-d36b-486d-95d8-247522411bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:05.948798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468cfe3-d36b-486d-95d8-247522411bfd admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:05.949091 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468cfe3-d36b-486d-95d8-247522411bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:05.949363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468cfe3-d36b-486d-95d8-247522411bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:05.950059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468cfe3-d36b-486d-95d8-247522411bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:05.951991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468cfe3-d36b-486d-95d8-247522411bfd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.025360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 775/1561] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:06.026304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8f58-3b3b-4bd8-a703-00011ffb5d98 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.061146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 787/1562] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:05 2021] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:06.062874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468cfe3-d36b-486d-95d8-247522411bfd admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.085978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8f58-3b3b-4bd8-a703-00011ffb5d98 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.135892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468cfe3-d36b-486d-95d8-247522411bfd admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.141307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d16b-e5e6-4ae5-bc5d-ba025d1863d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.141978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d16b-e5e6-4ae5-bc5d-ba025d1863d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.142260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d16b-e5e6-4ae5-bc5d-ba025d1863d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.142633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d16b-e5e6-4ae5-bc5d-ba025d1863d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.143204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf59a8-5825-4271-8cd8-9f38a0edc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.143458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d16b-e5e6-4ae5-bc5d-ba025d1863d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.143859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf59a8-5825-4271-8cd8-9f38a0edc695 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.144159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf59a8-5825-4271-8cd8-9f38a0edc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.144425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf59a8-5825-4271-8cd8-9f38a0edc695 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.145138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf59a8-5825-4271-8cd8-9f38a0edc695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.145295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d16b-e5e6-4ae5-bc5d-ba025d1863d7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.147048 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf59a8-5825-4271-8cd8-9f38a0edc695 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.271329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 788/1563] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:06 2021] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:06.272232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d16b-e5e6-4ae5-bc5d-ba025d1863d7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.282352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d16b-e5e6-4ae5-bc5d-ba025d1863d7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.286981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08e11b-febb-4f99-a535-5b30e9d5e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.287607 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e11b-febb-4f99-a535-5b30e9d5e15f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.287885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e11b-febb-4f99-a535-5b30e9d5e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.288156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e11b-febb-4f99-a535-5b30e9d5e15f admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.288879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e11b-febb-4f99-a535-5b30e9d5e15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.290529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e11b-febb-4f99-a535-5b30e9d5e15f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.300249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 789/1564] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:06.301118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08e11b-febb-4f99-a535-5b30e9d5e15f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.310686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08e11b-febb-4f99-a535-5b30e9d5e15f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.315019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 776/1565] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:06 2021] POST /identity/v3/projects => generated 391 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:06.315019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf59a8-5825-4271-8cd8-9f38a0edc695 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.364785 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75fc3e-2865-4c2d-88ef-47f987de67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.365690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75fc3e-2865-4c2d-88ef-47f987de67d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.365966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75fc3e-2865-4c2d-88ef-47f987de67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.366235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75fc3e-2865-4c2d-88ef-47f987de67d1 admin admin] PATH_INFO: `/v3/projects/8986096a5559469682c7b91b20a2f70f/users/c712e3d4431c4204ad4dfc381d96a06e/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.372626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf59a8-5825-4271-8cd8-9f38a0edc695 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.377258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668960-3bec-4544-bde3-161226f4548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.377968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668960-3bec-4544-bde3-161226f4548f admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.378271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668960-3bec-4544-bde3-161226f4548f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.378524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668960-3bec-4544-bde3-161226f4548f admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.379239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92668960-3bec-4544-bde3-161226f4548f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.381177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92668960-3bec-4544-bde3-161226f4548f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.381547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75fc3e-2865-4c2d-88ef-47f987de67d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8986096a5559469682c7b91b20a2f70f, user_id=c712e3d4431c4204ad4dfc381d96a06e, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.385005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75fc3e-2865-4c2d-88ef-47f987de67d1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.568725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 790/1566] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:06 2021] PUT /identity/v3/projects/8986096a5559469682c7b91b20a2f70f/users/c712e3d4431c4204ad4dfc381d96a06e/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:06.569564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75fc3e-2865-4c2d-88ef-47f987de67d1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.601918 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 777/1567] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:06 2021] POST /identity/v3/users => generated 287 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:06.602773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668960-3bec-4544-bde3-161226f4548f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.613074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668960-3bec-4544-bde3-161226f4548f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.629902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75fc3e-2865-4c2d-88ef-47f987de67d1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.635411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd4e2-425b-4ae8-992c-58319ee3ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.636123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd4e2-425b-4ae8-992c-58319ee3ddf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.636404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd4e2-425b-4ae8-992c-58319ee3ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.636675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd4e2-425b-4ae8-992c-58319ee3ddf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.637414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd4e2-425b-4ae8-992c-58319ee3ddf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.639040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd4e2-425b-4ae8-992c-58319ee3ddf1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.648712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 791/1568] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:06.649646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd4e2-425b-4ae8-992c-58319ee3ddf1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.661004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd4e2-425b-4ae8-992c-58319ee3ddf1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.665665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1deef-272d-4b2a-8628-19ca5542312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.666319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1deef-272d-4b2a-8628-19ca5542312e admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.666628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1deef-272d-4b2a-8628-19ca5542312e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.666905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1deef-272d-4b2a-8628-19ca5542312e admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.667597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1deef-272d-4b2a-8628-19ca5542312e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.669344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2829-ddc1-4894-ac92-c3681883ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.669495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1deef-272d-4b2a-8628-19ca5542312e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.670016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2829-ddc1-4894-ac92-c3681883ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.670281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2829-ddc1-4894-ac92-c3681883ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.670567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2829-ddc1-4894-ac92-c3681883ec98 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.671259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e2829-ddc1-4894-ac92-c3681883ec98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.673130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e2829-ddc1-4894-ac92-c3681883ec98 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.746085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 792/1569] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:06 2021] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:06.747028 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1deef-272d-4b2a-8628-19ca5542312e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.756410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1deef-272d-4b2a-8628-19ca5542312e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.761920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d48cf5-b38d-4508-a211-01c66dec87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.762569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d48cf5-b38d-4508-a211-01c66dec87ac admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.762863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d48cf5-b38d-4508-a211-01c66dec87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.763133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d48cf5-b38d-4508-a211-01c66dec87ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.763874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d48cf5-b38d-4508-a211-01c66dec87ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.765449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d48cf5-b38d-4508-a211-01c66dec87ac admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.775205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 793/1570] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:06.777353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d48cf5-b38d-4508-a211-01c66dec87ac admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.785473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d48cf5-b38d-4508-a211-01c66dec87ac admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.790029 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154df658-9eba-4aa3-873a-77fca49ac166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.790688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154df658-9eba-4aa3-873a-77fca49ac166 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.790967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154df658-9eba-4aa3-873a-77fca49ac166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.791237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154df658-9eba-4aa3-873a-77fca49ac166 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.791948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154df658-9eba-4aa3-873a-77fca49ac166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.793492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154df658-9eba-4aa3-873a-77fca49ac166 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.802382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 778/1571] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:06 2021] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:06.803288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2829-ddc1-4894-ac92-c3681883ec98 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.804219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 794/1572] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:06.806045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b0ec0-f17c-4c79-85ab-d5e6c9d5c0c5 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.806257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b0ec0-f17c-4c79-85ab-d5e6c9d5c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.806564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b0ec0-f17c-4c79-85ab-d5e6c9d5c0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.816539 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2829-ddc1-4894-ac92-c3681883ec98 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.821859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518fa5-2e99-4df7-a541-c64b880fe65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.822453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518fa5-2e99-4df7-a541-c64b880fe65f admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.822779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518fa5-2e99-4df7-a541-c64b880fe65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.823065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518fa5-2e99-4df7-a541-c64b880fe65f admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.823759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518fa5-2e99-4df7-a541-c64b880fe65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.825665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518fa5-2e99-4df7-a541-c64b880fe65f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.833830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ae1b0ec0-f17c-4c79-85ab-d5e6c9d5c0c5 None None] MFA Rules not processed for user `c712e3d4431c4204ad4dfc381d96a06e`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:06.835173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ae1b0ec0-f17c-4c79-85ab-d5e6c9d5c0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:06.896133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 795/1573] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:06.896944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b0ec0-f17c-4c79-85ab-d5e6c9d5c0c5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.909604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b0ec0-f17c-4c79-85ab-d5e6c9d5c0c5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.913754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 779/1574] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:06 2021] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:06.915442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518fa5-2e99-4df7-a541-c64b880fe65f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.919519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f854-ee20-4561-aff8-4c85592b7789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.920242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f854-ee20-4561-aff8-4c85592b7789 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.920513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f854-ee20-4561-aff8-4c85592b7789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.920780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f854-ee20-4561-aff8-4c85592b7789 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.921544 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f854-ee20-4561-aff8-4c85592b7789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.923181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f854-ee20-4561-aff8-4c85592b7789 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.925339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518fa5-2e99-4df7-a541-c64b880fe65f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.930013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e064a-92c8-48ad-b045-43363138c647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.931310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e064a-92c8-48ad-b045-43363138c647 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.931589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e064a-92c8-48ad-b045-43363138c647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.931860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e064a-92c8-48ad-b045-43363138c647 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.932589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e064a-92c8-48ad-b045-43363138c647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.934153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 796/1575] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:06.934334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e064a-92c8-48ad-b045-43363138c647 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.934974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f854-ee20-4561-aff8-4c85592b7789 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.944289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f854-ee20-4561-aff8-4c85592b7789 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.945125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 780/1576] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:06.945972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e064a-92c8-48ad-b045-43363138c647 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.951513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072841-54e8-4c50-83ba-a10aeab6eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.952239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072841-54e8-4c50-83ba-a10aeab6eb46 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.952583 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072841-54e8-4c50-83ba-a10aeab6eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.952928 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072841-54e8-4c50-83ba-a10aeab6eb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.953719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05072841-54e8-4c50-83ba-a10aeab6eb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.955336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e064a-92c8-48ad-b045-43363138c647 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.955570 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05072841-54e8-4c50-83ba-a10aeab6eb46 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.960168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96271bd0-0841-4d81-9919-9775341c9db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.960795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96271bd0-0841-4d81-9919-9775341c9db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.961072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96271bd0-0841-4d81-9919-9775341c9db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.961400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96271bd0-0841-4d81-9919-9775341c9db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.962114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96271bd0-0841-4d81-9919-9775341c9db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.963701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96271bd0-0841-4d81-9919-9775341c9db3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.968887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 797/1577] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:06.968887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072841-54e8-4c50-83ba-a10aeab6eb46 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.974318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 781/1578] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:06.975255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96271bd0-0841-4d81-9919-9775341c9db3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:06.975988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072841-54e8-4c50-83ba-a10aeab6eb46 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.982207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260f71b-f769-4aca-9a4f-d109c41558e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.982975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260f71b-f769-4aca-9a4f-d109c41558e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.983419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260f71b-f769-4aca-9a4f-d109c41558e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.983853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260f71b-f769-4aca-9a4f-d109c41558e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.984653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260f71b-f769-4aca-9a4f-d109c41558e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:06.986297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96271bd0-0841-4d81-9919-9775341c9db3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:06.986510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260f71b-f769-4aca-9a4f-d109c41558e5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:06.990971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74fb6-db2d-4a84-ab62-887173e2e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:06.991836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74fb6-db2d-4a84-ab62-887173e2e965 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:06.992113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74fb6-db2d-4a84-ab62-887173e2e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:06.992386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74fb6-db2d-4a84-ab62-887173e2e965 admin admin] PATH_INFO: `/v3/projects/cceb60931e5541518c468df87510c262/users/fd27fcaf54b54d80971beadb9b14d1e7/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:06.998750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 798/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:07.000297 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd21b06-8c4f-45df-ac67-418e6c8497b9 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.000599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd21b06-8c4f-45df-ac67-418e6c8497b9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.000857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd21b06-8c4f-45df-ac67-418e6c8497b9 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.002618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 799/1580] 10.222.0.16 () {54 vars in 961 bytes} [Thu Nov 11 17:14:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:14:07.003176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd21b06-8c4f-45df-ac67-418e6c8497b9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.011097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea74fb6-db2d-4a84-ab62-887173e2e965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cceb60931e5541518c468df87510c262, user_id=fd27fcaf54b54d80971beadb9b14d1e7, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.014665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea74fb6-db2d-4a84-ab62-887173e2e965 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.015625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd21b06-8c4f-45df-ac67-418e6c8497b9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.020178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c203c3d-9856-4081-bb2b-dbafd4f85652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.020840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c203c3d-9856-4081-bb2b-dbafd4f85652 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.021115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c203c3d-9856-4081-bb2b-dbafd4f85652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.021387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c203c3d-9856-4081-bb2b-dbafd4f85652 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.022104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c203c3d-9856-4081-bb2b-dbafd4f85652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.023724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c203c3d-9856-4081-bb2b-dbafd4f85652 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.033309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 800/1581] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:07.034074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c203c3d-9856-4081-bb2b-dbafd4f85652 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.043618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c203c3d-9856-4081-bb2b-dbafd4f85652 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.048134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9f582-1440-4b67-aa78-9980a26eebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.048740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f582-1440-4b67-aa78-9980a26eebd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.049017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f582-1440-4b67-aa78-9980a26eebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.049286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f582-1440-4b67-aa78-9980a26eebd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.049990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9f582-1440-4b67-aa78-9980a26eebd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.051576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9f582-1440-4b67-aa78-9980a26eebd0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.061517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 801/1582] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:07.062255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9f582-1440-4b67-aa78-9980a26eebd0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.071145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9f582-1440-4b67-aa78-9980a26eebd0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.075597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5a462-b04c-42fe-8bc1-4afb26d53b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.076412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5a462-b04c-42fe-8bc1-4afb26d53b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.076690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5a462-b04c-42fe-8bc1-4afb26d53b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.076956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5a462-b04c-42fe-8bc1-4afb26d53b62 admin admin] PATH_INFO: `/v3/projects/34577e94e3cb42d6b73cd1f88c6f8b80/users/12126356102d40fc8700a337ff68c4bd/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.091175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5a462-b04c-42fe-8bc1-4afb26d53b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34577e94e3cb42d6b73cd1f88c6f8b80, user_id=12126356102d40fc8700a337ff68c4bd, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.093753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 782/1583] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:06 2021] PUT /identity/v3/projects/cceb60931e5541518c468df87510c262/users/fd27fcaf54b54d80971beadb9b14d1e7/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:07.093892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5a462-b04c-42fe-8bc1-4afb26d53b62 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.094809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74fb6-db2d-4a84-ab62-887173e2e965 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.158403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74fb6-db2d-4a84-ab62-887173e2e965 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.163509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a7b35-b3a9-46f2-aa63-66a3c837a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.164214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7b35-b3a9-46f2-aa63-66a3c837a076 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.164517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7b35-b3a9-46f2-aa63-66a3c837a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.164793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a7b35-b3a9-46f2-aa63-66a3c837a076 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.165558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a7b35-b3a9-46f2-aa63-66a3c837a076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.167312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a7b35-b3a9-46f2-aa63-66a3c837a076 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.177083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 783/1584] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:07.177855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a7b35-b3a9-46f2-aa63-66a3c837a076 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.180784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 802/1585] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:07 2021] PUT /identity/v3/projects/34577e94e3cb42d6b73cd1f88c6f8b80/users/12126356102d40fc8700a337ff68c4bd/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:07.180784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5a462-b04c-42fe-8bc1-4afb26d53b62 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.187072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a7b35-b3a9-46f2-aa63-66a3c837a076 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.240820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4938d2-204b-4217-902f-0d2d3ef08715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.241699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4938d2-204b-4217-902f-0d2d3ef08715 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.241974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4938d2-204b-4217-902f-0d2d3ef08715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.242245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4938d2-204b-4217-902f-0d2d3ef08715 admin admin] PATH_INFO: `/v3/projects/de3d593ae8f64484a9df99f8d96171a0/users/607eb2bd09b04b0d999b69b6e799700e/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.245047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5a462-b04c-42fe-8bc1-4afb26d53b62 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.249701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001a548-14de-4c12-976e-4f46e62ea58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.250383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a548-14de-4c12-976e-4f46e62ea58f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.250699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a548-14de-4c12-976e-4f46e62ea58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.250973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a548-14de-4c12-976e-4f46e62ea58f admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.251763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001a548-14de-4c12-976e-4f46e62ea58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.253354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001a548-14de-4c12-976e-4f46e62ea58f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.256537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4938d2-204b-4217-902f-0d2d3ef08715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3d593ae8f64484a9df99f8d96171a0, user_id=607eb2bd09b04b0d999b69b6e799700e, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.259718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4938d2-204b-4217-902f-0d2d3ef08715 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.264158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 803/1586] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:07.265659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e425fc4-d386-4f33-8635-44abb9c97e4b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.265871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e425fc4-d386-4f33-8635-44abb9c97e4b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.266148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e425fc4-d386-4f33-8635-44abb9c97e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.283723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3e425fc4-d386-4f33-8635-44abb9c97e4b None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:07.284906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3e425fc4-d386-4f33-8635-44abb9c97e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:07.347727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 804/1587] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Nov 11 17:14:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:07.348562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e425fc4-d386-4f33-8635-44abb9c97e4b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.358278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e425fc4-d386-4f33-8635-44abb9c97e4b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.363024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d73e3-f993-45a0-b13e-ea3bda6bea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.363672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d73e3-f993-45a0-b13e-ea3bda6bea18 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.363949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d73e3-f993-45a0-b13e-ea3bda6bea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.364221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d73e3-f993-45a0-b13e-ea3bda6bea18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.364943 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d73e3-f993-45a0-b13e-ea3bda6bea18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.366597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d73e3-f993-45a0-b13e-ea3bda6bea18 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.368191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 784/1588] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:07 2021] PUT /identity/v3/projects/de3d593ae8f64484a9df99f8d96171a0/users/607eb2bd09b04b0d999b69b6e799700e/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:07.369009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4938d2-204b-4217-902f-0d2d3ef08715 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.377252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 805/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:07.378534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e7af-c9dc-4f5b-807d-ee6615244e5e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.378838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e7af-c9dc-4f5b-807d-ee6615244e5e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.379114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e7af-c9dc-4f5b-807d-ee6615244e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.397425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-65e8e7af-c9dc-4f5b-807d-ee6615244e5e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:07.398650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-65e8e7af-c9dc-4f5b-807d-ee6615244e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:07.434886 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4938d2-204b-4217-902f-0d2d3ef08715 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.439580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2d7e4-025e-4997-a67b-d8ab3a9f2ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.440455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d7e4-025e-4997-a67b-d8ab3a9f2ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.440793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d7e4-025e-4997-a67b-d8ab3a9f2ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.441064 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d7e4-025e-4997-a67b-d8ab3a9f2ae8 admin admin] PATH_INFO: `/v3/projects/8bbb84d5262f485ea496b74b7a20e8e6/users/c5f9f009a61e4cf5974bfe20168fbcf3/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.455558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2d7e4-025e-4997-a67b-d8ab3a9f2ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbb84d5262f485ea496b74b7a20e8e6, user_id=c5f9f009a61e4cf5974bfe20168fbcf3, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.455815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 806/1590] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:07.459016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e7af-c9dc-4f5b-807d-ee6615244e5e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.459139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2d7e4-025e-4997-a67b-d8ab3a9f2ae8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.465525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e7af-c9dc-4f5b-807d-ee6615244e5e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.470121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d46c5-99f8-44d6-9960-9abdf95ea7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.471046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d46c5-99f8-44d6-9960-9abdf95ea7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.471325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d46c5-99f8-44d6-9960-9abdf95ea7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.471601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d46c5-99f8-44d6-9960-9abdf95ea7ff admin admin] PATH_INFO: `/v3/projects/3a6e5bdc578b460ab28a883efa598f95/users/cce6286edfa545718b20566887102f3e/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.485767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d46c5-99f8-44d6-9960-9abdf95ea7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6e5bdc578b460ab28a883efa598f95, user_id=cce6286edfa545718b20566887102f3e, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.488432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d46c5-99f8-44d6-9960-9abdf95ea7ff admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.596423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 785/1591] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:07 2021] PUT /identity/v3/projects/8bbb84d5262f485ea496b74b7a20e8e6/users/c5f9f009a61e4cf5974bfe20168fbcf3/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:07.597702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0968483-a7c1-4818-adda-253e3c7b09cd None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.598037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0968483-a7c1-4818-adda-253e3c7b09cd None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.598255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0968483-a7c1-4818-adda-253e3c7b09cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.614771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-f0968483-a7c1-4818-adda-253e3c7b09cd None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:07.615979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f0968483-a7c1-4818-adda-253e3c7b09cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:07.628746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 807/1592] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:07 2021] PUT /identity/v3/projects/3a6e5bdc578b460ab28a883efa598f95/users/cce6286edfa545718b20566887102f3e/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:07.630041 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d46c5-99f8-44d6-9960-9abdf95ea7ff admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.676228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 786/1593] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:07.677446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0968483-a7c1-4818-adda-253e3c7b09cd None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.694082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d46c5-99f8-44d6-9960-9abdf95ea7ff admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.698674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79dab7-6541-42aa-a0e1-c5a4f214925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.700059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dab7-6541-42aa-a0e1-c5a4f214925a admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.700343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dab7-6541-42aa-a0e1-c5a4f214925a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.700614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79dab7-6541-42aa-a0e1-c5a4f214925a admin admin] PATH_INFO: `/v3/projects/54d914912f14454eb3a0e20f2354fee0/users/6a22f763c3844c798e6ed6f093c9ec66/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.714792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79dab7-6541-42aa-a0e1-c5a4f214925a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d914912f14454eb3a0e20f2354fee0, user_id=6a22f763c3844c798e6ed6f093c9ec66, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.717480 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79dab7-6541-42aa-a0e1-c5a4f214925a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.744379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0968483-a7c1-4818-adda-253e3c7b09cd None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.797363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 808/1594] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:07 2021] PUT /identity/v3/projects/54d914912f14454eb3a0e20f2354fee0/users/6a22f763c3844c798e6ed6f093c9ec66/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:07.798973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c732-5be6-433a-bd37-bfa3dfe0b6fb None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.799256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c732-5be6-433a-bd37-bfa3dfe0b6fb None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.799660 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c732-5be6-433a-bd37-bfa3dfe0b6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.810792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0313bf-7d94-440a-8561-06bcb8d4c6d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.811477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0313bf-7d94-440a-8561-06bcb8d4c6d4 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.811828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0313bf-7d94-440a-8561-06bcb8d4c6d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.812079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0313bf-7d94-440a-8561-06bcb8d4c6d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.827552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0231c732-5be6-433a-bd37-bfa3dfe0b6fb None None] MFA Rules not processed for user `607eb2bd09b04b0d999b69b6e799700e`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:07.828984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0231c732-5be6-433a-bd37-bfa3dfe0b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:07.864570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0313bf-7d94-440a-8561-06bcb8d4c6d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.866096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0313bf-7d94-440a-8561-06bcb8d4c6d4 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.875675 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 787/1595] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:07 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:07.876582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0313bf-7d94-440a-8561-06bcb8d4c6d4 service nova] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.887755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0313bf-7d94-440a-8561-06bcb8d4c6d4 service nova] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.892718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 809/1596] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:07 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:07.893740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231c732-5be6-433a-bd37-bfa3dfe0b6fb None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:07.954201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450283a-9ff8-4ee6-beb3-0911cc42c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.954452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231c732-5be6-433a-bd37-bfa3dfe0b6fb None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:07.955681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450283a-9ff8-4ee6-beb3-0911cc42c848 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.956222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450283a-9ff8-4ee6-beb3-0911cc42c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.956505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450283a-9ff8-4ee6-beb3-0911cc42c848 admin admin] PATH_INFO: `/v3/projects/ed26d137d98846b9b45708f7e581e9b0/users/55ae75b130bf4a38a81d48b87c14a464/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.958653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c3477-fe72-4652-ba40-fd9afca694fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:07.960024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3477-fe72-4652-ba40-fd9afca694fc service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.960307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3477-fe72-4652-ba40-fd9afca694fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.960581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3477-fe72-4652-ba40-fd9afca694fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:07.970779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c3477-fe72-4652-ba40-fd9afca694fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.972647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450283a-9ff8-4ee6-beb3-0911cc42c848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed26d137d98846b9b45708f7e581e9b0, user_id=55ae75b130bf4a38a81d48b87c14a464, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:07.972811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c3477-fe72-4652-ba40-fd9afca694fc service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.975388 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450283a-9ff8-4ee6-beb3-0911cc42c848 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:07.984585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 810/1597] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:07.986075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5397c-720d-4df2-804b-99d593a6daaf None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:07.986439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5397c-720d-4df2-804b-99d593a6daaf None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:07.986802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5397c-720d-4df2-804b-99d593a6daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.018826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-6cc5397c-720d-4df2-804b-99d593a6daaf None None] MFA Rules not processed for user `c5f9f009a61e4cf5974bfe20168fbcf3`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:08.020222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6cc5397c-720d-4df2-804b-99d593a6daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:08.084144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 811/1598] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:07 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:08.090933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2ca6-f212-4db0-a8d7-acb0af398bba None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.090933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2ca6-f212-4db0-a8d7-acb0af398bba None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.090933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2ca6-f212-4db0-a8d7-acb0af398bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.108036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 788/1599] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:07 2021] PUT /identity/v3/projects/ed26d137d98846b9b45708f7e581e9b0/users/55ae75b130bf4a38a81d48b87c14a464/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:08.109272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450283a-9ff8-4ee6-beb3-0911cc42c848 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.118919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-065d2ca6-f212-4db0-a8d7-acb0af398bba None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:08.123910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-065d2ca6-f212-4db0-a8d7-acb0af398bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:08.205110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 812/1600] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:08.206855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac629c-04c0-4154-b186-e95481568270 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.207517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac629c-04c0-4154-b186-e95481568270 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.208002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac629c-04c0-4154-b186-e95481568270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.219220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450283a-9ff8-4ee6-beb3-0911cc42c848 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.223349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff057c1-b291-4144-a5cb-e7b083f61ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.224000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff057c1-b291-4144-a5cb-e7b083f61ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.224277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff057c1-b291-4144-a5cb-e7b083f61ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.224977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff057c1-b291-4144-a5cb-e7b083f61ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.236541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff057c1-b291-4144-a5cb-e7b083f61ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.246968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff057c1-b291-4144-a5cb-e7b083f61ef9 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:08.247262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-26ac629c-04c0-4154-b186-e95481568270 None None] MFA Rules not processed for user `6a22f763c3844c798e6ed6f093c9ec66`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:08.247262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-26ac629c-04c0-4154-b186-e95481568270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:08.248254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 789/1601] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:08.249035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff057c1-b291-4144-a5cb-e7b083f61ef9 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.258234 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff057c1-b291-4144-a5cb-e7b083f61ef9 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.262938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f042-1415-45ba-a0bd-ad7200250fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.263582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f042-1415-45ba-a0bd-ad7200250fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.263863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f042-1415-45ba-a0bd-ad7200250fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.264137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635f042-1415-45ba-a0bd-ad7200250fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.264828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635f042-1415-45ba-a0bd-ad7200250fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.266801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635f042-1415-45ba-a0bd-ad7200250fe6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:08.309464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 813/1602] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:08.310821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddffc-e36d-43df-b6da-3a23531a841a None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.311105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddffc-e36d-43df-b6da-3a23531a841a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.311377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddffc-e36d-43df-b6da-3a23531a841a None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.312998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 814/1603] 10.222.0.16 () {54 vars in 961 bytes} [Thu Nov 11 17:14:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:14:08.314047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa25fa-466a-4e97-a98d-005acf5868c6 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.314321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa25fa-466a-4e97-a98d-005acf5868c6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.314658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa25fa-466a-4e97-a98d-005acf5868c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.331591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dbaa25fa-466a-4e97-a98d-005acf5868c6 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:08.332778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dbaa25fa-466a-4e97-a98d-005acf5868c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:08.340722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 815/1604] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:08.344319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa25fa-466a-4e97-a98d-005acf5868c6 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.344319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dbaa25fa-466a-4e97-a98d-005acf5868c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:08.356449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa25fa-466a-4e97-a98d-005acf5868c6 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.360015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc378d0-bfa6-4ca4-9e85-b0b8c3bf856e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.360681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc378d0-bfa6-4ca4-9e85-b0b8c3bf856e service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.360960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc378d0-bfa6-4ca4-9e85-b0b8c3bf856e service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.361229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc378d0-bfa6-4ca4-9e85-b0b8c3bf856e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.370581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc378d0-bfa6-4ca4-9e85-b0b8c3bf856e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.372015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc378d0-bfa6-4ca4-9e85-b0b8c3bf856e service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:08.381159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 816/1605] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:08.382370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440586e9-6362-4494-831f-72d3108b97dc None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.382776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440586e9-6362-4494-831f-72d3108b97dc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.382992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440586e9-6362-4494-831f-72d3108b97dc None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.385174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 817/1606] 10.222.0.16 () {54 vars in 912 bytes} [Thu Nov 11 17:14:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:14:08.387657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67d4f-4e24-437a-bd7c-1f2038c6247d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.387939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67d4f-4e24-437a-bd7c-1f2038c6247d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.388216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67d4f-4e24-437a-bd7c-1f2038c6247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.406875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-6ac67d4f-4e24-437a-bd7c-1f2038c6247d None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:08.408069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6ac67d4f-4e24-437a-bd7c-1f2038c6247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:08.440523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 790/1607] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:08 2021] POST /identity/v3/projects => generated 401 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:08.440523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f042-1415-45ba-a0bd-ad7200250fe6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.514338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 818/1608] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Nov 11 17:14:08 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:08.516137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b0d79-88ac-4aef-8fc3-d6612c3bc66c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.516592 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b0d79-88ac-4aef-8fc3-d6612c3bc66c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.517023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b0d79-88ac-4aef-8fc3-d6612c3bc66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.526247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635f042-1415-45ba-a0bd-ad7200250fe6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.530113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf1a30-0732-45d7-bc13-eec8452e4402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.530670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf1a30-0732-45d7-bc13-eec8452e4402 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.530952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf1a30-0732-45d7-bc13-eec8452e4402 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.531379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf1a30-0732-45d7-bc13-eec8452e4402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.538393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-334b0d79-88ac-4aef-8fc3-d6612c3bc66c None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:08.539766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-334b0d79-88ac-4aef-8fc3-d6612c3bc66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:08.600601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf1a30-0732-45d7-bc13-eec8452e4402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.602159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf1a30-0732-45d7-bc13-eec8452e4402 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:08.616356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 791/1609] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:08.617168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf1a30-0732-45d7-bc13-eec8452e4402 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.629758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf1a30-0732-45d7-bc13-eec8452e4402 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.632253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cac137-f216-4a5d-bb19-b4c8a12d0dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.632922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cac137-f216-4a5d-bb19-b4c8a12d0dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.633752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cac137-f216-4a5d-bb19-b4c8a12d0dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.634033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cac137-f216-4a5d-bb19-b4c8a12d0dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.634590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 819/1610] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:14:08 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:08.635043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cac137-f216-4a5d-bb19-b4c8a12d0dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.635730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b0d79-88ac-4aef-8fc3-d6612c3bc66c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.637092 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cac137-f216-4a5d-bb19-b4c8a12d0dc3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:08.654856 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b0d79-88ac-4aef-8fc3-d6612c3bc66c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.660822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ee1c-d092-40cb-be49-7f7588dd2f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.661473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ee1c-d092-40cb-be49-7f7588dd2f3a service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.661751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ee1c-d092-40cb-be49-7f7588dd2f3a service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.662021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ee1c-d092-40cb-be49-7f7588dd2f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.721456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825ee1c-d092-40cb-be49-7f7588dd2f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.723334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825ee1c-d092-40cb-be49-7f7588dd2f3a service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:08.733009 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 820/1611] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:08 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:08.733744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ee1c-d092-40cb-be49-7f7588dd2f3a service nova] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.820444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 792/1612] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:08 2021] POST /identity/v3/users => generated 307 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:08.825379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cac137-f216-4a5d-bb19-b4c8a12d0dc3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.858503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cac137-f216-4a5d-bb19-b4c8a12d0dc3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.865938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69af71-d7a7-4159-85d0-67457b839e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.866639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69af71-d7a7-4159-85d0-67457b839e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.866928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69af71-d7a7-4159-85d0-67457b839e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.867197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69af71-d7a7-4159-85d0-67457b839e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.868713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69af71-d7a7-4159-85d0-67457b839e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.870566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69af71-d7a7-4159-85d0-67457b839e20 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:08.885865 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 793/1613] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:08 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:08.886066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ee1c-d092-40cb-be49-7f7588dd2f3a service nova] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.887518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69af71-d7a7-4159-85d0-67457b839e20 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:08.890399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb4579-3cd0-4c97-bcce-884834a84742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.891579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4579-3cd0-4c97-bcce-884834a84742 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.892169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4579-3cd0-4c97-bcce-884834a84742 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.892649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4579-3cd0-4c97-bcce-884834a84742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.906690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69af71-d7a7-4159-85d0-67457b839e20 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:08.913199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2a16f-e412-4932-a962-fec0defe6f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:08.914113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a16f-e412-4932-a962-fec0defe6f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:08.914565 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a16f-e412-4932-a962-fec0defe6f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:08.914740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a16f-e412-4932-a962-fec0defe6f24 admin admin] PATH_INFO: `/v3/projects/84c50d971c504690aab3eaecbaad3b64/users/4f29c11693f14f9cbdda468533ab5bed/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:08.916284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb4579-3cd0-4c97-bcce-884834a84742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.918000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb4579-3cd0-4c97-bcce-884834a84742 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:08.935387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 821/1614] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:08.938926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2a16f-e412-4932-a962-fec0defe6f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c50d971c504690aab3eaecbaad3b64, user_id=4f29c11693f14f9cbdda468533ab5bed, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:08.942643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2a16f-e412-4932-a962-fec0defe6f24 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:09.107336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 794/1615] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:08 2021] PUT /identity/v3/projects/84c50d971c504690aab3eaecbaad3b64/users/4f29c11693f14f9cbdda468533ab5bed/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:09.113010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb4579-3cd0-4c97-bcce-884834a84742 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:09.114882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2a16f-e412-4932-a962-fec0defe6f24 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:09.129723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb4579-3cd0-4c97-bcce-884834a84742 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:09.234833 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2a16f-e412-4932-a962-fec0defe6f24 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:09.242296 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99bda9-5fa1-4ac0-a999-559897937bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:09.243335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99bda9-5fa1-4ac0-a999-559897937bdc service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:09.243738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99bda9-5fa1-4ac0-a999-559897937bdc service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:09.244123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99bda9-5fa1-4ac0-a999-559897937bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:09.248038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a0888-917f-4172-9cd6-4654625ab3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:09.253399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a0888-917f-4172-9cd6-4654625ab3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:09.253881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a0888-917f-4172-9cd6-4654625ab3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:09.254239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a0888-917f-4172-9cd6-4654625ab3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:09.255282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a0888-917f-4172-9cd6-4654625ab3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:09.259843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a0888-917f-4172-9cd6-4654625ab3cb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:09.275777 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 822/1616] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:09 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:09.279805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a0888-917f-4172-9cd6-4654625ab3cb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:09.296731 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a0888-917f-4172-9cd6-4654625ab3cb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:09.301730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe2190-6b9b-43fa-9c6e-7538b20a7ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:09.302749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe2190-6b9b-43fa-9c6e-7538b20a7ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:09.303174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe2190-6b9b-43fa-9c6e-7538b20a7ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:09.303461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe2190-6b9b-43fa-9c6e-7538b20a7ecb admin admin] PATH_INFO: `/v3/projects/84c50d971c504690aab3eaecbaad3b64/users/4f29c11693f14f9cbdda468533ab5bed/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:09.306284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe2190-6b9b-43fa-9c6e-7538b20a7ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c50d971c504690aab3eaecbaad3b64, user_id=4f29c11693f14f9cbdda468533ab5bed, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:09.309123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe2190-6b9b-43fa-9c6e-7538b20a7ecb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:09.316402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99bda9-5fa1-4ac0-a999-559897937bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:09.318144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99bda9-5fa1-4ac0-a999-559897937bdc service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:09.319766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 823/1617] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:09 2021] PUT /identity/v3/projects/84c50d971c504690aab3eaecbaad3b64/users/4f29c11693f14f9cbdda468533ab5bed/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:09.331630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219849d-15d5-4388-b500-73e8d0cda8ea None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:09.332182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219849d-15d5-4388-b500-73e8d0cda8ea None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:09.332319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 795/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:09 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:09.332468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219849d-15d5-4388-b500-73e8d0cda8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:09.360908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9219849d-15d5-4388-b500-73e8d0cda8ea None None] MFA Rules not processed for user `4f29c11693f14f9cbdda468533ab5bed`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:09.362451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9219849d-15d5-4388-b500-73e8d0cda8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:09.369303 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff096-3050-4069-9098-859cc5d65c15 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:09.369674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff096-3050-4069-9098-859cc5d65c15 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:09.369941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff096-3050-4069-9098-859cc5d65c15 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:09.372062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 796/1619] 10.222.0.16 () {54 vars in 912 bytes} [Thu Nov 11 17:14:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:14:09.377765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1b759-42f5-43f0-96bd-a69e501e38f8 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:09.378021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1b759-42f5-43f0-96bd-a69e501e38f8 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:09.378319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1b759-42f5-43f0-96bd-a69e501e38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:09.424220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e5b1b759-42f5-43f0-96bd-a69e501e38f8 None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:09.427191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e5b1b759-42f5-43f0-96bd-a69e501e38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:09.506585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 824/1620] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:09 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:09.514017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219849d-15d5-4388-b500-73e8d0cda8ea None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:09.594455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 797/1621] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:14:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:09.613659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219849d-15d5-4388-b500-73e8d0cda8ea None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:09.617496 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bbbd4-c12f-4047-b31e-2ca1da888730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:09.618805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bbbd4-c12f-4047-b31e-2ca1da888730 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:09.619153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bbbd4-c12f-4047-b31e-2ca1da888730 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:09.619492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bbbd4-c12f-4047-b31e-2ca1da888730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:09.629754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bbbd4-c12f-4047-b31e-2ca1da888730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:09.634581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bbbd4-c12f-4047-b31e-2ca1da888730 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:09.644514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 825/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:09 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:09.781271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1b759-42f5-43f0-96bd-a69e501e38f8 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:09.795710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1b759-42f5-43f0-96bd-a69e501e38f8 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:09.800813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6f585-c9b5-47b9-8c7c-33e372896d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:09.801748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f585-c9b5-47b9-8c7c-33e372896d25 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:09.802414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f585-c9b5-47b9-8c7c-33e372896d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:09.802891 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6f585-c9b5-47b9-8c7c-33e372896d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:09.815637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6f585-c9b5-47b9-8c7c-33e372896d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:09.820851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6f585-c9b5-47b9-8c7c-33e372896d25 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:09.828438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 798/1623] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:10.238313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe249d-39b1-4bef-8511-5b9bef51835e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:10.238655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe249d-39b1-4bef-8511-5b9bef51835e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:10.238936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe249d-39b1-4bef-8511-5b9bef51835e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:10.267444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6f585-c9b5-47b9-8c7c-33e372896d25 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:10.276786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6f585-c9b5-47b9-8c7c-33e372896d25 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:10.291460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba307209-f36f-4913-a42a-d77c99bb441c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:10.294223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba307209-f36f-4913-a42a-d77c99bb441c service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:10.297225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba307209-f36f-4913-a42a-d77c99bb441c service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:10.307635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba307209-f36f-4913-a42a-d77c99bb441c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:10.334419 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-fabe249d-39b1-4bef-8511-5b9bef51835e None None] MFA Rules not processed for user `12126356102d40fc8700a337ff68c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:10.338739 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-fabe249d-39b1-4bef-8511-5b9bef51835e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:10.412868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba307209-f36f-4913-a42a-d77c99bb441c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:10.415800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba307209-f36f-4913-a42a-d77c99bb441c service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:10.426275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 799/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:10 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:10.427726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e541c-b2b6-4811-a757-97af283fb648 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:10.428021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e541c-b2b6-4811-a757-97af283fb648 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:10.428301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e541c-b2b6-4811-a757-97af283fb648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:10.446974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 826/1625] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:10 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:10.464101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe249d-39b1-4bef-8511-5b9bef51835e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:10.464542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b06e541c-b2b6-4811-a757-97af283fb648 None None] MFA Rules not processed for user `fd27fcaf54b54d80971beadb9b14d1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:10.464542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b06e541c-b2b6-4811-a757-97af283fb648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:10.548404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe249d-39b1-4bef-8511-5b9bef51835e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:10.561812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 800/1626] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:10.563520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45903-6bba-42d7-8b4b-de029d31c2f2 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:10.564548 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45903-6bba-42d7-8b4b-de029d31c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:10.564863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45903-6bba-42d7-8b4b-de029d31c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:10.568779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb992-40d1-4bc7-966b-a416b8a69640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:10.569513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb992-40d1-4bc7-966b-a416b8a69640 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:10.569791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb992-40d1-4bc7-966b-a416b8a69640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:10.570123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bb992-40d1-4bc7-966b-a416b8a69640 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:10.571628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bb992-40d1-4bc7-966b-a416b8a69640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:10.574521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bb992-40d1-4bc7-966b-a416b8a69640 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:10.629427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9ff45903-6bba-42d7-8b4b-de029d31c2f2 None None] MFA Rules not processed for user `fd27fcaf54b54d80971beadb9b14d1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:10.630618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9ff45903-6bba-42d7-8b4b-de029d31c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:10.642623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 801/1627] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:10.718092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 827/1628] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:10 2021] POST /identity/v3/projects => generated 405 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:10.722298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff45903-6bba-42d7-8b4b-de029d31c2f2 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:10.733847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff45903-6bba-42d7-8b4b-de029d31c2f2 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:10.811501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b9021-ff5a-4e15-a14d-575d6b918567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:10.812208 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b9021-ff5a-4e15-a14d-575d6b918567 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:10.812503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b9021-ff5a-4e15-a14d-575d6b918567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:10.812782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b9021-ff5a-4e15-a14d-575d6b918567 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:10.813577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b9021-ff5a-4e15-a14d-575d6b918567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:10.815968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b9021-ff5a-4e15-a14d-575d6b918567 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:10.902451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 802/1629] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:10 2021] POST /identity/v3/users => generated 309 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:10.906514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb992-40d1-4bc7-966b-a416b8a69640 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:10.923793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bb992-40d1-4bc7-966b-a416b8a69640 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:10.938711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c123d6f-fc46-4cc8-8ebb-b2193eeb2890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:10.941678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c123d6f-fc46-4cc8-8ebb-b2193eeb2890 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:10.941678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c123d6f-fc46-4cc8-8ebb-b2193eeb2890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:10.941678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c123d6f-fc46-4cc8-8ebb-b2193eeb2890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:10.941678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c123d6f-fc46-4cc8-8ebb-b2193eeb2890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:10.943523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c123d6f-fc46-4cc8-8ebb-b2193eeb2890 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:10.983615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 828/1630] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:10 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:10.991976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b9021-ff5a-4e15-a14d-575d6b918567 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:11.015131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b9021-ff5a-4e15-a14d-575d6b918567 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:11.038716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b20674-a412-46d3-bce9-0388c3966a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:11.039698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20674-a412-46d3-bce9-0388c3966a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:11.046755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20674-a412-46d3-bce9-0388c3966a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:11.047214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20674-a412-46d3-bce9-0388c3966a33 admin admin] PATH_INFO: `/v3/projects/c1b1c9fcde6f43aebc661f303149f3e6/users/2fcba0dd05294c26a512532d92222636/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:11.082939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b20674-a412-46d3-bce9-0388c3966a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b1c9fcde6f43aebc661f303149f3e6, user_id=2fcba0dd05294c26a512532d92222636, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:11.085610 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b20674-a412-46d3-bce9-0388c3966a33 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:11.120227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c123d6f-fc46-4cc8-8ebb-b2193eeb2890 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:11.223790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c123d6f-fc46-4cc8-8ebb-b2193eeb2890 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:11.237061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3269ef-09b6-4baf-8104-1c19099a86d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:11.237730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3269ef-09b6-4baf-8104-1c19099a86d4 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:11.238064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3269ef-09b6-4baf-8104-1c19099a86d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:11.238344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3269ef-09b6-4baf-8104-1c19099a86d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:11.288421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 803/1631] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:10 2021] PUT /identity/v3/projects/c1b1c9fcde6f43aebc661f303149f3e6/users/2fcba0dd05294c26a512532d92222636/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:11.295553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b20674-a412-46d3-bce9-0388c3966a33 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:11.339061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3269ef-09b6-4baf-8104-1c19099a86d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:11.341533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3269ef-09b6-4baf-8104-1c19099a86d4 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:11.379735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 829/1632] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:11 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:11.508728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b20674-a412-46d3-bce9-0388c3966a33 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:11.520516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951769b-2b52-42ed-ad42-2e1395cf209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:11.520516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951769b-2b52-42ed-ad42-2e1395cf209b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:11.520819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951769b-2b52-42ed-ad42-2e1395cf209b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:11.521373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951769b-2b52-42ed-ad42-2e1395cf209b admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:11.523114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951769b-2b52-42ed-ad42-2e1395cf209b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:11.530281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951769b-2b52-42ed-ad42-2e1395cf209b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:11.552550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 804/1633] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:11.558479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3269ef-09b6-4baf-8104-1c19099a86d4 service nova] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:11.586047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951769b-2b52-42ed-ad42-2e1395cf209b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:11.586961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3269ef-09b6-4baf-8104-1c19099a86d4 service nova] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:11.591258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c0304-639f-432b-a500-289fc42c8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:11.592222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c0304-639f-432b-a500-289fc42c8be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:11.593102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c0304-639f-432b-a500-289fc42c8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:11.593102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c0304-639f-432b-a500-289fc42c8be3 admin admin] PATH_INFO: `/v3/projects/c1b1c9fcde6f43aebc661f303149f3e6/users/2fcba0dd05294c26a512532d92222636/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:11.595212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c0304-639f-432b-a500-289fc42c8be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b1c9fcde6f43aebc661f303149f3e6, user_id=2fcba0dd05294c26a512532d92222636, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:11.598017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c0304-639f-432b-a500-289fc42c8be3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:11.599894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951769b-2b52-42ed-ad42-2e1395cf209b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:11.609864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:11.610900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 830/1634] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:11 2021] PUT /identity/v3/projects/c1b1c9fcde6f43aebc661f303149f3e6/users/2fcba0dd05294c26a512532d92222636/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:11.615800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:11.616263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:11.616691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] PATH_INFO: `/v3/users/c5f9f009a61e4cf5974bfe20168fbcf3` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:11.618701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f9f009a61e4cf5974bfe20168fbcf3)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:11.620701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:11.873734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f9f009a61e4cf5974bfe20168fbcf3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:11.874994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f9f009a61e4cf5974bfe20168fbcf3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:11.875608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f9f009a61e4cf5974bfe20168fbcf3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:11.985764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f9f009a61e4cf5974bfe20168fbcf3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:12.007027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d7b45f14-76e8-4329-a119-53671a5b1d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f9f009a61e4cf5974bfe20168fbcf3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:12.029515 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 805/1635] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:11 2021] DELETE /identity/v3/users/c5f9f009a61e4cf5974bfe20168fbcf3 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:12.031293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4adde8-58b3-4edd-9996-642db1d0b70c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:12.031804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4adde8-58b3-4edd-9996-642db1d0b70c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:12.031917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4adde8-58b3-4edd-9996-642db1d0b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:12.055921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2f4adde8-58b3-4edd-9996-642db1d0b70c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:12.057548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2f4adde8-58b3-4edd-9996-642db1d0b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:12.128928 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 831/1636] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:12.141922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6631e-3c73-4a3e-9b94-e23ce7e18970 None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:12.144753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6631e-3c73-4a3e-9b94-e23ce7e18970 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:12.144753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6631e-3c73-4a3e-9b94-e23ce7e18970 None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:12.144753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 806/1637] 10.222.0.16 () {54 vars in 912 bytes} [Thu Nov 11 17:14:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:14:12.147638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4adde8-58b3-4edd-9996-642db1d0b70c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:12.149428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2f4adde8-58b3-4edd-9996-642db1d0b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:12.150483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1489c-5b70-4e68-8a9a-c86b40eea1e5 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:12.150801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1489c-5b70-4e68-8a9a-c86b40eea1e5 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:12.151103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1489c-5b70-4e68-8a9a-c86b40eea1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:12.220574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-82b1489c-5b70-4e68-8a9a-c86b40eea1e5 None None] MFA Rules not processed for user `872474833e2f49c9a9ceccef8914e2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:12.223059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-82b1489c-5b70-4e68-8a9a-c86b40eea1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:12.288170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4adde8-58b3-4edd-9996-642db1d0b70c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:12.296949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43837d29-c20a-4b61-8d71-07fc1233d947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:12.297650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837d29-c20a-4b61-8d71-07fc1233d947 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:12.297925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837d29-c20a-4b61-8d71-07fc1233d947 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:12.298204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837d29-c20a-4b61-8d71-07fc1233d947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:12.309183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 807/1638] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:14:12 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:12.328361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43837d29-c20a-4b61-8d71-07fc1233d947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:12.328361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43837d29-c20a-4b61-8d71-07fc1233d947 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:12.361936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1489c-5b70-4e68-8a9a-c86b40eea1e5 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:12.366214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 832/1639] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:12.372188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1489c-5b70-4e68-8a9a-c86b40eea1e5 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:12.377177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527a444-237a-4f5d-a7b0-2884a7d86f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:12.378175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a444-237a-4f5d-a7b0-2884a7d86f85 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:12.378554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a444-237a-4f5d-a7b0-2884a7d86f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:12.379002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a444-237a-4f5d-a7b0-2884a7d86f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:12.387514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527a444-237a-4f5d-a7b0-2884a7d86f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:12.389087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527a444-237a-4f5d-a7b0-2884a7d86f85 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:12.398604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 808/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:13.297489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97b96-790c-4121-8128-d6197b729c2a None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:13.297975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97b96-790c-4121-8128-d6197b729c2a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:13.298070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a97b96-790c-4121-8128-d6197b729c2a None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:13.300367 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 833/1641] 10.222.0.16 () {54 vars in 960 bytes} [Thu Nov 11 17:14:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:14:13.306990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fd03-cdcb-4d71-aab5-2888c1479ca6 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:13.307513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fd03-cdcb-4d71-aab5-2888c1479ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:13.307513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fd03-cdcb-4d71-aab5-2888c1479ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:13.331870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6c82fd03-cdcb-4d71-aab5-2888c1479ca6 None None] MFA Rules not processed for user `db055fddc41c4eb0ba1c3b410e1e8e03`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:13.333344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6c82fd03-cdcb-4d71-aab5-2888c1479ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:13.464708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 809/1642] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Nov 11 17:14:13 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 11 17:14:13.474996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a97b96-790c-4121-8128-d6197b729c2a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:13.500899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a97b96-790c-4121-8128-d6197b729c2a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:13.514833 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820b77-5476-49df-bfe4-4e207cb833b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db055fddc41c4eb0ba1c3b410e1e8e03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:13.515764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b77-5476-49df-bfe4-4e207cb833b7 service placement] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:13.516271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b77-5476-49df-bfe4-4e207cb833b7 service placement] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:13.516747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b77-5476-49df-bfe4-4e207cb833b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:13.520391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7f820b77-5476-49df-bfe4-4e207cb833b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:13.544384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820b77-5476-49df-bfe4-4e207cb833b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:13.546529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f820b77-5476-49df-bfe4-4e207cb833b7 service placement] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:13.569655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 834/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:13.715724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82fd03-cdcb-4d71-aab5-2888c1479ca6 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:13.717084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6c82fd03-cdcb-4d71-aab5-2888c1479ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:13.745767 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82fd03-cdcb-4d71-aab5-2888c1479ca6 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:13.756923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:13.756923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:13.757259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:13.757338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] PATH_INFO: `/v3/projects/8bbb84d5262f485ea496b74b7a20e8e6` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:13.758620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbb84d5262f485ea496b74b7a20e8e6)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:13.759669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: WARNING py.warnings [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 17:14:13.759669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: warnings.warn(msg) Nov 11 17:14:13.759669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: Nov 11 17:14:13.761059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:13.950650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbb84d5262f485ea496b74b7a20e8e6', 'request_id': 'req-61e20f21-978d-47f6-a572-865d72837e9c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:14.047794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbb84d5262f485ea496b74b7a20e8e6', 'request_id': 'req-61e20f21-978d-47f6-a572-865d72837e9c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:14.058158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbb84d5262f485ea496b74b7a20e8e6', 'request_id': 'req-61e20f21-978d-47f6-a572-865d72837e9c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:14.078296 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] The token cache is being invalidate because project 8bbb84d5262f485ea496b74b7a20e8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:14.078963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:14.080601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61e20f21-978d-47f6-a572-865d72837e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:14.093562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 810/1644] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:13 2021] DELETE /identity/v3/projects/8bbb84d5262f485ea496b74b7a20e8e6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:14.095364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3653f-b59b-49a8-9b8b-a9cadbcdb8f7 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.095712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3653f-b59b-49a8-9b8b-a9cadbcdb8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.095999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3653f-b59b-49a8-9b8b-a9cadbcdb8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:14.123369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-63d3653f-b59b-49a8-9b8b-a9cadbcdb8f7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:14.124818 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-63d3653f-b59b-49a8-9b8b-a9cadbcdb8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:14.231192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 835/1645] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:14.240318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4075c-2feb-44e6-8d34-adcf8245357d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.240318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4075c-2feb-44e6-8d34-adcf8245357d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.240318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4075c-2feb-44e6-8d34-adcf8245357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:14.266960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5fa4075c-2feb-44e6-8d34-adcf8245357d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:14.268507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5fa4075c-2feb-44e6-8d34-adcf8245357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:14.280506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 811/1646] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:14.286057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3653f-b59b-49a8-9b8b-a9cadbcdb8f7 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:14.300499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3653f-b59b-49a8-9b8b-a9cadbcdb8f7 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:14.320401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:14.321615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.322086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.322506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:14.323431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:14.323896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:14.325678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:14.350256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 836/1647] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:14.355447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4075c-2feb-44e6-8d34-adcf8245357d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:14.379709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4075c-2feb-44e6-8d34-adcf8245357d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:14.391183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f69b3-234f-46ed-8339-5bb4eefd4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:14.392459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f69b3-234f-46ed-8339-5bb4eefd4734 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.392921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f69b3-234f-46ed-8339-5bb4eefd4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.393821 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f69b3-234f-46ed-8339-5bb4eefd4734 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:14.395522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f69b3-234f-46ed-8339-5bb4eefd4734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:14.397318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f69b3-234f-46ed-8339-5bb4eefd4734 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:14.554033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 812/1648] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:14 2021] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:14.558648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:14.572199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588725-78d0-483b-a040-d0bacdb18e5a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:14.642194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41954-1bb6-4ad0-83b9-75b9e2eaa0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:14.642926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41954-1bb6-4ad0-83b9-75b9e2eaa0de admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.643476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41954-1bb6-4ad0-83b9-75b9e2eaa0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.643817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41954-1bb6-4ad0-83b9-75b9e2eaa0de admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:14.644721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab41954-1bb6-4ad0-83b9-75b9e2eaa0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:14.647414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab41954-1bb6-4ad0-83b9-75b9e2eaa0de admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:14.746516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 837/1649] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:14 2021] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:14.750392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f69b3-234f-46ed-8339-5bb4eefd4734 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:14.770457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f69b3-234f-46ed-8339-5bb4eefd4734 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:14.775470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfa594-7ee2-4c38-b278-1a5a11124122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:14.776524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa594-7ee2-4c38-b278-1a5a11124122 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.776809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa594-7ee2-4c38-b278-1a5a11124122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.777079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa594-7ee2-4c38-b278-1a5a11124122 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:14.778754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfa594-7ee2-4c38-b278-1a5a11124122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:14.780653 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfa594-7ee2-4c38-b278-1a5a11124122 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:14.831364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41954-1bb6-4ad0-83b9-75b9e2eaa0de admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:14.831649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 813/1650] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:14 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:14.849918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41954-1bb6-4ad0-83b9-75b9e2eaa0de admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:14.870809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa3e79-82ee-482b-a8e9-ad8eab4b956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:14.871925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa3e79-82ee-482b-a8e9-ad8eab4b956d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.872439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa3e79-82ee-482b-a8e9-ad8eab4b956d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.872918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa3e79-82ee-482b-a8e9-ad8eab4b956d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:14.873907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa3e79-82ee-482b-a8e9-ad8eab4b956d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:14.876007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa3e79-82ee-482b-a8e9-ad8eab4b956d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:14.904456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 838/1651] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:14 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:14.906427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfa594-7ee2-4c38-b278-1a5a11124122 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:14.928495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfa594-7ee2-4c38-b278-1a5a11124122 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:14.947121 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e25521-d17b-400d-b17e-2f166376f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:14.949479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e25521-d17b-400d-b17e-2f166376f997 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.955584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e25521-d17b-400d-b17e-2f166376f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.956160 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e25521-d17b-400d-b17e-2f166376f997 admin admin] PATH_INFO: `/v3/projects/c691c2216e2241449729ab2b57f3cea3/users/f0a64173df7c4c0a8fd5e4f074676bf7/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:14.996587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793711-55e3-4355-90aa-b5da3e3c8626 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:14.996587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793711-55e3-4355-90aa-b5da3e3c8626 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:14.996587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be793711-55e3-4355-90aa-b5da3e3c8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:15.015596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e25521-d17b-400d-b17e-2f166376f997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c691c2216e2241449729ab2b57f3cea3, user_id=f0a64173df7c4c0a8fd5e4f074676bf7, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:15.025966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e25521-d17b-400d-b17e-2f166376f997 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:15.060200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-be793711-55e3-4355-90aa-b5da3e3c8626 None None] MFA Rules not processed for user `2fcba0dd05294c26a512532d92222636`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:15.063533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-be793711-55e3-4355-90aa-b5da3e3c8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:15.118496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 814/1652] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:14 2021] PUT /identity/v3/projects/c691c2216e2241449729ab2b57f3cea3/users/f0a64173df7c4c0a8fd5e4f074676bf7/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:15.129296 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809bec-6fe7-44ab-b534-c955916717cc None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:15.129588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809bec-6fe7-44ab-b534-c955916717cc None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:15.129903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809bec-6fe7-44ab-b534-c955916717cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:15.233361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-f0809bec-6fe7-44ab-b534-c955916717cc None None] MFA Rules not processed for user `f0a64173df7c4c0a8fd5e4f074676bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:15.237533 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f0809bec-6fe7-44ab-b534-c955916717cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:15.274156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 839/1653] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:14 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:15.381222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 815/1654] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:15 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:15.385966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793711-55e3-4355-90aa-b5da3e3c8626 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:15.403984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be793711-55e3-4355-90aa-b5da3e3c8626 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:15.525542 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7194bf-baaf-44f0-b19d-ae3c89774772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:15.526670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7194bf-baaf-44f0-b19d-ae3c89774772 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:15.527054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7194bf-baaf-44f0-b19d-ae3c89774772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:15.527406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7194bf-baaf-44f0-b19d-ae3c89774772 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:15.528204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7194bf-baaf-44f0-b19d-ae3c89774772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:15.532605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7194bf-baaf-44f0-b19d-ae3c89774772 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:15.695856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809bec-6fe7-44ab-b534-c955916717cc None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:15.709634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 840/1655] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:15 2021] POST /identity/v3/projects => generated 371 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:15.713655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809bec-6fe7-44ab-b534-c955916717cc None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:15.823368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb1ec-0f5e-4b9a-bed7-fd7a6c2a71b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:15.824095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb1ec-0f5e-4b9a-bed7-fd7a6c2a71b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:15.824482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb1ec-0f5e-4b9a-bed7-fd7a6c2a71b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:15.824860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bb1ec-0f5e-4b9a-bed7-fd7a6c2a71b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:15.826361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bb1ec-0f5e-4b9a-bed7-fd7a6c2a71b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:15.829909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bb1ec-0f5e-4b9a-bed7-fd7a6c2a71b9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:15.943503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 816/1656] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:15 2021] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:15.948108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7194bf-baaf-44f0-b19d-ae3c89774772 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:15.966979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7194bf-baaf-44f0-b19d-ae3c89774772 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:15.988086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b305a3-8b19-427d-b604-4cbf04e0f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:15.988766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b305a3-8b19-427d-b604-4cbf04e0f66a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:15.989047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b305a3-8b19-427d-b604-4cbf04e0f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:15.989387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b305a3-8b19-427d-b604-4cbf04e0f66a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:15.990128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b305a3-8b19-427d-b604-4cbf04e0f66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:15.991779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b305a3-8b19-427d-b604-4cbf04e0f66a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:16.027231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 841/1657] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:15 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:16.029488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb1ec-0f5e-4b9a-bed7-fd7a6c2a71b9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:16.043790 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bb1ec-0f5e-4b9a-bed7-fd7a6c2a71b9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:16.049439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0b80-d705-47e3-be53-eea82d162ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:16.050283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0b80-d705-47e3-be53-eea82d162ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:16.050611 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0b80-d705-47e3-be53-eea82d162ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:16.050899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0b80-d705-47e3-be53-eea82d162ae1 admin admin] PATH_INFO: `/v3/projects/d6e00c3820f4483e8ed58ea833622a06/users/173f575d58cc4843a78a6b4ecf89b051/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:16.071469 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd0b80-d705-47e3-be53-eea82d162ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e00c3820f4483e8ed58ea833622a06, user_id=173f575d58cc4843a78a6b4ecf89b051, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:16.075911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd0b80-d705-47e3-be53-eea82d162ae1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:16.160779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 817/1658] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:16 2021] PUT /identity/v3/projects/d6e00c3820f4483e8ed58ea833622a06/users/173f575d58cc4843a78a6b4ecf89b051/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:16.161219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b305a3-8b19-427d-b604-4cbf04e0f66a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:16.172228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b305a3-8b19-427d-b604-4cbf04e0f66a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:16.310321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96737-1d93-458e-884d-96e7bb413c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:16.312732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96737-1d93-458e-884d-96e7bb413c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:16.313233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96737-1d93-458e-884d-96e7bb413c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:16.314897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96737-1d93-458e-884d-96e7bb413c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:16.315880 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96737-1d93-458e-884d-96e7bb413c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:16.317998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f96737-1d93-458e-884d-96e7bb413c3d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:16.342528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 842/1659] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:16 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:16.347376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0b80-d705-47e3-be53-eea82d162ae1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:16.362620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0b80-d705-47e3-be53-eea82d162ae1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:16.378334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:16.379521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:16.379889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:16.380180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] PATH_INFO: `/v3/projects/d6e00c3820f4483e8ed58ea833622a06/users/173f575d58cc4843a78a6b4ecf89b051/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:16.385967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e00c3820f4483e8ed58ea833622a06, user_id=173f575d58cc4843a78a6b4ecf89b051, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:16.390729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:16.413484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 818/1660] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:16 2021] PUT /identity/v3/projects/d6e00c3820f4483e8ed58ea833622a06/users/173f575d58cc4843a78a6b4ecf89b051/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:16.414507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732996de-a10a-4585-b0d3-0ade47329d8b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:16.415079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732996de-a10a-4585-b0d3-0ade47329d8b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:16.415079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732996de-a10a-4585-b0d3-0ade47329d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:16.464623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-732996de-a10a-4585-b0d3-0ade47329d8b None None] MFA Rules not processed for user `173f575d58cc4843a78a6b4ecf89b051`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:16.466758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-732996de-a10a-4585-b0d3-0ade47329d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:16.630838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 843/1661] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:16 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:16.689823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:16.696643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:16.773285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b3fe-668e-4020-8c21-26b701673308 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:16.784866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:16.785408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:16.785697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:16.785972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:16.812491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:16.815091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:16.828615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 819/1662] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:16 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:17.916506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732996de-a10a-4585-b0d3-0ade47329d8b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:18.089886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732996de-a10a-4585-b0d3-0ade47329d8b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:18.090567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:18.090567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:18.093596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:18.094569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:18.094858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:18.095137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] PATH_INFO: `/v3/users/f0a64173df7c4c0a8fd5e4f074676bf7` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:18.098836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a64173df7c4c0a8fd5e4f074676bf7)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:18.101011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: WARNING py.warnings [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 11 17:14:18.101011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: warnings.warn(msg) Nov 11 17:14:18.101011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: Nov 11 17:14:18.103713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:18.103886 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e8f4-fc5f-4d16-8885-388213d59286 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:18.140530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:18.145512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:18.145856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:18.147455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] PATH_INFO: `/v3/users/6a22f763c3844c798e6ed6f093c9ec66` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:18.150386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a22f763c3844c798e6ed6f093c9ec66)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:18.155280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:18.476201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a64173df7c4c0a8fd5e4f074676bf7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.477962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a64173df7c4c0a8fd5e4f074676bf7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.479738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a64173df7c4c0a8fd5e4f074676bf7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.810856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a22f763c3844c798e6ed6f093c9ec66'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.810856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a22f763c3844c798e6ed6f093c9ec66'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.810856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a22f763c3844c798e6ed6f093c9ec66'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.812440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a64173df7c4c0a8fd5e4f074676bf7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.812440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-23c8baa2-d8f2-41ed-a513-bf0cb5046958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a64173df7c4c0a8fd5e4f074676bf7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.812440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 844/1663] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:17 2021] DELETE /identity/v3/users/f0a64173df7c4c0a8fd5e4f074676bf7 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:18.812440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73ecc-7bfc-4b4a-b57a-76c256e2b293 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:18.812440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73ecc-7bfc-4b4a-b57a-76c256e2b293 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:18.812440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73ecc-7bfc-4b4a-b57a-76c256e2b293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:18.813874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-72b73ecc-7bfc-4b4a-b57a-76c256e2b293 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:18.813874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-72b73ecc-7bfc-4b4a-b57a-76c256e2b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:18.815810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a22f763c3844c798e6ed6f093c9ec66'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.816466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 845/1664] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:18.816682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a22f763c3844c798e6ed6f093c9ec66'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:18.816682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 820/1665] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:18 2021] DELETE /identity/v3/users/6a22f763c3844c798e6ed6f093c9ec66 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:18.816945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd6e4e-5664-4100-9098-cd9b5619df20 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:18.816945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd6e4e-5664-4100-9098-cd9b5619df20 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:18.816945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd6e4e-5664-4100-9098-cd9b5619df20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:18.826292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:18.832499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-d4cd6e4e-5664-4100-9098-cd9b5619df20 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:18.833860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d4cd6e4e-5664-4100-9098-cd9b5619df20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:18.860381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:18.959113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 846/1666] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:18.960686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd6e4e-5664-4100-9098-cd9b5619df20 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:18.963071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d4cd6e4e-5664-4100-9098-cd9b5619df20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:19.003266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178b5c-92e2-4f2a-8f68-e3ba486c5cf9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:19.015339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:19.018397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:19.018397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:19.020541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] PATH_INFO: `/v3/users/607eb2bd09b04b0d999b69b6e799700e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:19.023769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=607eb2bd09b04b0d999b69b6e799700e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:19.026859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:19.041224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd6e4e-5664-4100-9098-cd9b5619df20 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:19.045468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:19.046617 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:19.047079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:19.047465 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:19.077236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:19.080290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:19.112600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 847/1667] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:19.219918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:19.221726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:19.243368 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd61b4-d61c-439f-a8f3-903479f6d426 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:19.255926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607eb2bd09b04b0d999b69b6e799700e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:19.257164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b141d-1c5f-4d82-a20a-d9ed82369a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:19.257293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607eb2bd09b04b0d999b69b6e799700e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:19.258268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b141d-1c5f-4d82-a20a-d9ed82369a65 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:19.258655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607eb2bd09b04b0d999b69b6e799700e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:19.259044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b141d-1c5f-4d82-a20a-d9ed82369a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:19.259517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b141d-1c5f-4d82-a20a-d9ed82369a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:19.265396 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1d3b141d-1c5f-4d82-a20a-d9ed82369a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:19.298336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b141d-1c5f-4d82-a20a-d9ed82369a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:19.310144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b141d-1c5f-4d82-a20a-d9ed82369a65 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:19.345717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 848/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:19.351278 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607eb2bd09b04b0d999b69b6e799700e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:19.393290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-120e74d5-cf0f-4a08-a322-e50b74c2af74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607eb2bd09b04b0d999b69b6e799700e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:19.431353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 821/1669] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:18 2021] DELETE /identity/v3/users/607eb2bd09b04b0d999b69b6e799700e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:19.436334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f50e-7f91-4abf-b5f5-8499f2bc11e8 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:19.436759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f50e-7f91-4abf-b5f5-8499f2bc11e8 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:19.437135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f50e-7f91-4abf-b5f5-8499f2bc11e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:19.495822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-eb87f50e-7f91-4abf-b5f5-8499f2bc11e8 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:19.497240 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-eb87f50e-7f91-4abf-b5f5-8499f2bc11e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:19.615011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03916fa-6e3a-4881-9d80-8041d8a4fa5d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:19.615488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03916fa-6e3a-4881-9d80-8041d8a4fa5d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:19.616041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03916fa-6e3a-4881-9d80-8041d8a4fa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:19.636936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 849/1670] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:19.642839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d03916fa-6e3a-4881-9d80-8041d8a4fa5d None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:19.644238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d03916fa-6e3a-4881-9d80-8041d8a4fa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:19.684775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f50e-7f91-4abf-b5f5-8499f2bc11e8 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:19.686637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-eb87f50e-7f91-4abf-b5f5-8499f2bc11e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:19.748788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 822/1671] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:14:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:19.798499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f50e-7f91-4abf-b5f5-8499f2bc11e8 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:19.804814 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26d347-48f3-4ce4-a6e3-2e6c121c30a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:19.805665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d347-48f3-4ce4-a6e3-2e6c121c30a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:19.813890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d347-48f3-4ce4-a6e3-2e6c121c30a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:19.813890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d347-48f3-4ce4-a6e3-2e6c121c30a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:19.829598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26d347-48f3-4ce4-a6e3-2e6c121c30a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:19.834392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26d347-48f3-4ce4-a6e3-2e6c121c30a6 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:19.849190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f226f3b-0116-45ee-9a71-606e3ad5519b None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:19.853102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f226f3b-0116-45ee-9a71-606e3ad5519b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:19.853102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f226f3b-0116-45ee-9a71-606e3ad5519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:19.853553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 850/1672] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:19.892257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5f226f3b-0116-45ee-9a71-606e3ad5519b None None] MFA Rules not processed for user `55ae75b130bf4a38a81d48b87c14a464`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:19.899503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5f226f3b-0116-45ee-9a71-606e3ad5519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.034589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 823/1673] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:19 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:20.039595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b069f-f1aa-4ff0-a2bf-b29d64cb4a25 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:20.040204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b069f-f1aa-4ff0-a2bf-b29d64cb4a25 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:20.040633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b069f-f1aa-4ff0-a2bf-b29d64cb4a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:20.061892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4d9b069f-f1aa-4ff0-a2bf-b29d64cb4a25 None None] MFA Rules not processed for user `55ae75b130bf4a38a81d48b87c14a464`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:20.063017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f226f3b-0116-45ee-9a71-606e3ad5519b None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:20.063222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4d9b069f-f1aa-4ff0-a2bf-b29d64cb4a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.068640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5f226f3b-0116-45ee-9a71-606e3ad5519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.071462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 851/1674] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:20 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:20.083382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b069f-f1aa-4ff0-a2bf-b29d64cb4a25 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:20.084879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4d9b069f-f1aa-4ff0-a2bf-b29d64cb4a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.113146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f226f3b-0116-45ee-9a71-606e3ad5519b None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:20.124397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:20.125395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:20.125675 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:20.125984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] PATH_INFO: `/v3/users/12126356102d40fc8700a337ff68c4bd` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:20.131414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12126356102d40fc8700a337ff68c4bd)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:20.134070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:20.200091 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b069f-f1aa-4ff0-a2bf-b29d64cb4a25 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:20.213355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662c194-c654-45f2-8bb9-8d561fccac3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:20.214035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662c194-c654-45f2-8bb9-8d561fccac3a service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:20.214349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662c194-c654-45f2-8bb9-8d561fccac3a service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:20.214660 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662c194-c654-45f2-8bb9-8d561fccac3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:20.229793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662c194-c654-45f2-8bb9-8d561fccac3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:20.229793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662c194-c654-45f2-8bb9-8d561fccac3a service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:20.241863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 852/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:20 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:20.384999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94ffbd-1b52-465c-aa9d-4103ca50d3c4 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:20.385670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94ffbd-1b52-465c-aa9d-4103ca50d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:20.386471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94ffbd-1b52-465c-aa9d-4103ca50d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:20.432171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3c94ffbd-1b52-465c-aa9d-4103ca50d3c4 None None] MFA Rules not processed for user `cce6286edfa545718b20566887102f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:20.442010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3c94ffbd-1b52-465c-aa9d-4103ca50d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.552965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 853/1676] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:20 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:20.553741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94ffbd-1b52-465c-aa9d-4103ca50d3c4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:20.555624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3c94ffbd-1b52-465c-aa9d-4103ca50d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.589217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12126356102d40fc8700a337ff68c4bd'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:20.592420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12126356102d40fc8700a337ff68c4bd'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:20.594485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12126356102d40fc8700a337ff68c4bd'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:20.666590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94ffbd-1b52-465c-aa9d-4103ca50d3c4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:20.675552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:20.676258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:20.676532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:20.677623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:20.686597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.701928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12126356102d40fc8700a337ff68c4bd'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:20.702034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:20.702185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:20.713860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 854/1677] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:14:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:14:20.724209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:20.726034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.775924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8744053-1d7c-44e3-81bf-01655e5c1e73 service swift] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:20.786786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:20.787767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:20.788861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:20.789003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] PATH_INFO: `/v3/projects/de3d593ae8f64484a9df99f8d96171a0` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:20.791221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3d593ae8f64484a9df99f8d96171a0)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:20.793243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:20.795283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12126356102d40fc8700a337ff68c4bd'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:20.904991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 824/1678] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:20 2021] DELETE /identity/v3/users/12126356102d40fc8700a337ff68c4bd => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:20.913968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:20.919695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:20.974595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3d593ae8f64484a9df99f8d96171a0', 'request_id': 'req-53e440a4-1721-487d-bde7-1224a4253b71'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.082328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3d593ae8f64484a9df99f8d96171a0', 'request_id': 'req-53e440a4-1721-487d-bde7-1224a4253b71'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.090338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3d593ae8f64484a9df99f8d96171a0', 'request_id': 'req-53e440a4-1721-487d-bde7-1224a4253b71'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.167204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] The token cache is being invalidate because project de3d593ae8f64484a9df99f8d96171a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:21.167499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.169201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.180407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 855/1679] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:20 2021] DELETE /identity/v3/projects/de3d593ae8f64484a9df99f8d96171a0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:21.184178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:21.185746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:21.205288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281763be-9829-4ef2-aeb9-d693a23fd468 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:21.331491 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e440a4-1721-487d-bde7-1224a4253b71 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:21.348554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:21.349446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:21.349726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:21.349999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] PATH_INFO: `/v3/projects/54d914912f14454eb3a0e20f2354fee0` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:21.351254 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d914912f14454eb3a0e20f2354fee0)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:21.353897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:21.396031 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe4fd9-b8e2-4644-bd80-6baecb0f33fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:21.397747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe4fd9-b8e2-4644-bd80-6baecb0f33fa service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:21.398174 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe4fd9-b8e2-4644-bd80-6baecb0f33fa service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:21.401533 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe4fd9-b8e2-4644-bd80-6baecb0f33fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:21.419084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2bfe4fd9-b8e2-4644-bd80-6baecb0f33fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:21.500045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe4fd9-b8e2-4644-bd80-6baecb0f33fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:21.501961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe4fd9-b8e2-4644-bd80-6baecb0f33fa service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:21.523001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 825/1680] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:20 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:21.540923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6545b5-87b3-4bca-b7e0-304e0c8b971e None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:21.544165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6545b5-87b3-4bca-b7e0-304e0c8b971e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:21.544165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6545b5-87b3-4bca-b7e0-304e0c8b971e None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:21.544165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 826/1681] 10.222.0.16 () {54 vars in 912 bytes} [Thu Nov 11 17:14:21 2021] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:14:21.544165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6545b5-87b3-4bca-b7e0-304e0c8b971e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:21.555835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-af6545b5-87b3-4bca-b7e0-304e0c8b971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:21.557518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d914912f14454eb3a0e20f2354fee0', 'request_id': 'req-881211b5-8617-4d78-833a-d0723f97823b'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.665543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d914912f14454eb3a0e20f2354fee0', 'request_id': 'req-881211b5-8617-4d78-833a-d0723f97823b'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.672034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d914912f14454eb3a0e20f2354fee0', 'request_id': 'req-881211b5-8617-4d78-833a-d0723f97823b'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.696215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] The token cache is being invalidate because project 54d914912f14454eb3a0e20f2354fee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:21.711798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.714681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:21.720668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 856/1682] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:21 2021] DELETE /identity/v3/projects/54d914912f14454eb3a0e20f2354fee0 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:21.725792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:21.735799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:21.747188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6545b5-87b3-4bca-b7e0-304e0c8b971e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:21.754626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:21.756351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:21.757132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:21.757789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] PATH_INFO: `/v3/users/4f29c11693f14f9cbdda468533ab5bed` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:21.760475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f29c11693f14f9cbdda468533ab5bed)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:21.764370 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:21.776687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881211b5-8617-4d78-833a-d0723f97823b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:21.792159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:21.793068 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:21.793403 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:21.793673 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] PATH_INFO: `/v3/projects/c691c2216e2241449729ab2b57f3cea3` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:21.794983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c691c2216e2241449729ab2b57f3cea3)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:21.797052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:22.017999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f29c11693f14f9cbdda468533ab5bed'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.022709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f29c11693f14f9cbdda468533ab5bed'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.022709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f29c11693f14f9cbdda468533ab5bed'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.058395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c691c2216e2241449729ab2b57f3cea3', 'request_id': 'req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.099407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f29c11693f14f9cbdda468533ab5bed'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.121675 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4e59f4bc-2d7a-4445-b4f6-3dad9d557372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f29c11693f14f9cbdda468533ab5bed'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.168184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 827/1683] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:21 2021] DELETE /identity/v3/users/4f29c11693f14f9cbdda468533ab5bed => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:22.170661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4991b-cf1e-4ee1-8513-2c590c682587 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:22.180623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4991b-cf1e-4ee1-8513-2c590c682587 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:22.185291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c691c2216e2241449729ab2b57f3cea3', 'request_id': 'req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.190783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4991b-cf1e-4ee1-8513-2c590c682587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:22.194014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c691c2216e2241449729ab2b57f3cea3', 'request_id': 'req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.216032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] The token cache is being invalidate because project c691c2216e2241449729ab2b57f3cea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:22.218661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.218661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-fc9a2261-7ebd-4f5a-a5d8-87ff538ac247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.222174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 857/1684] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:21 2021] DELETE /identity/v3/projects/c691c2216e2241449729ab2b57f3cea3 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:22.227513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842362ad-80fa-4e56-b8fc-bd5103be596a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:22.228080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842362ad-80fa-4e56-b8fc-bd5103be596a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:22.228411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842362ad-80fa-4e56-b8fc-bd5103be596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:22.250882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-cbb4991b-cf1e-4ee1-8513-2c590c682587 None None] MFA Rules not processed for user `872474833e2f49c9a9ceccef8914e2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:22.252319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-cbb4991b-cf1e-4ee1-8513-2c590c682587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:22.257465 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-842362ad-80fa-4e56-b8fc-bd5103be596a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:22.259556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-842362ad-80fa-4e56-b8fc-bd5103be596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:22.345058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 828/1685] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:14:22 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:22.346157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4991b-cf1e-4ee1-8513-2c590c682587 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:22.348826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-cbb4991b-cf1e-4ee1-8513-2c590c682587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:22.434774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4991b-cf1e-4ee1-8513-2c590c682587 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:22.444579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:22.444715 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 858/1686] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:22.445783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:22.446019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c823df-77b4-40d4-9288-269d0dcf5eca None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:22.446326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c823df-77b4-40d4-9288-269d0dcf5eca None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:22.446633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:22.448253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] PATH_INFO: `/v3/projects/34577e94e3cb42d6b73cd1f88c6f8b80` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:22.449098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34577e94e3cb42d6b73cd1f88c6f8b80)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:22.451365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:22.454715 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c823df-77b4-40d4-9288-269d0dcf5eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:22.517772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-65c823df-77b4-40d4-9288-269d0dcf5eca None None] MFA Rules not processed for user `872474833e2f49c9a9ceccef8914e2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:22.519723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-65c823df-77b4-40d4-9288-269d0dcf5eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:22.548816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 859/1687] 10.222.0.10 () {58 vars in 1015 bytes} [Thu Nov 11 17:14:22 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:22.549935 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c823df-77b4-40d4-9288-269d0dcf5eca None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:22.557931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-65c823df-77b4-40d4-9288-269d0dcf5eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:22.597889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c823df-77b4-40d4-9288-269d0dcf5eca None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:22.612008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:22.613060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:22.613407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:22.613736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] PATH_INFO: `/v3/users/173f575d58cc4843a78a6b4ecf89b051` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:22.622401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173f575d58cc4843a78a6b4ecf89b051)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:22.628827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:22.640609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34577e94e3cb42d6b73cd1f88c6f8b80', 'request_id': 'req-c5b85232-46ef-4afc-b6fe-12748f23eca1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.716431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34577e94e3cb42d6b73cd1f88c6f8b80', 'request_id': 'req-c5b85232-46ef-4afc-b6fe-12748f23eca1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.723023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34577e94e3cb42d6b73cd1f88c6f8b80', 'request_id': 'req-c5b85232-46ef-4afc-b6fe-12748f23eca1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.749919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] The token cache is being invalidate because project 34577e94e3cb42d6b73cd1f88c6f8b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:22.750999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.751890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.760434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 829/1688] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:22 2021] DELETE /identity/v3/projects/34577e94e3cb42d6b73cd1f88c6f8b80 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:22.761617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:22.764009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:22.860265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b85232-46ef-4afc-b6fe-12748f23eca1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:22.864566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf89d5-f283-4aa4-a8fe-1885139936b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:22.865489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf89d5-f283-4aa4-a8fe-1885139936b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:22.866137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf89d5-f283-4aa4-a8fe-1885139936b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:22.866655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf89d5-f283-4aa4-a8fe-1885139936b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:22.869576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4acf89d5-f283-4aa4-a8fe-1885139936b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:22.874732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173f575d58cc4843a78a6b4ecf89b051'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.874732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173f575d58cc4843a78a6b4ecf89b051'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.874732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173f575d58cc4843a78a6b4ecf89b051'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:22.882845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf89d5-f283-4aa4-a8fe-1885139936b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:22.888531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf89d5-f283-4aa4-a8fe-1885139936b7 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:22.899743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 830/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:22.901623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3318d4-4208-4927-adad-89322c1f4500 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:22.902123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3318d4-4208-4927-adad-89322c1f4500 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:22.902646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3318d4-4208-4927-adad-89322c1f4500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:22.924811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-2f3318d4-4208-4927-adad-89322c1f4500 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:22.926204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2f3318d4-4208-4927-adad-89322c1f4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:22.990353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173f575d58cc4843a78a6b4ecf89b051'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:23.031633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173f575d58cc4843a78a6b4ecf89b051'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:23.100362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 860/1690] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:22 2021] DELETE /identity/v3/users/173f575d58cc4843a78a6b4ecf89b051 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:23.104839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:23.111266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 831/1691] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:23.112212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3318d4-4208-4927-adad-89322c1f4500 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:23.115303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:23.120588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2f3318d4-4208-4927-adad-89322c1f4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:23.221753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3318d4-4208-4927-adad-89322c1f4500 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:23.364374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdc7ef-25b0-45d2-8f7f-2f4f5f604241 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:23.387468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:23.388239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:23.388709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:23.388943 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] PATH_INFO: `/v3/users/c712e3d4431c4204ad4dfc381d96a06e` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:23.390629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c712e3d4431c4204ad4dfc381d96a06e)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:23.393088 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:23.464757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:23.465991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:23.466422 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:23.467106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:23.474165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:23.495939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:23.497851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:23.509056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 832/1692] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:23.516224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:23.516224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:23.553556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac6879-cdd6-4336-8055-45b66997dffa service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:23.582226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:23.583999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:23.584276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:23.584554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] PATH_INFO: `/v3/users/2fcba0dd05294c26a512532d92222636` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:23.587375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcba0dd05294c26a512532d92222636)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:23.589330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:23.983490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c712e3d4431c4204ad4dfc381d96a06e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:23.984686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c712e3d4431c4204ad4dfc381d96a06e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:23.985611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c712e3d4431c4204ad4dfc381d96a06e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:24.318897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c712e3d4431c4204ad4dfc381d96a06e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:24.333874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcba0dd05294c26a512532d92222636'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:24.335776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcba0dd05294c26a512532d92222636'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:24.336657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcba0dd05294c26a512532d92222636'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:24.353654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c712e3d4431c4204ad4dfc381d96a06e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:24.381846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 861/1693] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:23 2021] DELETE /identity/v3/users/c712e3d4431c4204ad4dfc381d96a06e => generated 0 bytes in 1281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:24.393434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:24.393434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:24.449215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcba0dd05294c26a512532d92222636'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:24.469969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcba0dd05294c26a512532d92222636'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:24.512805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 833/1694] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:23 2021] DELETE /identity/v3/users/2fcba0dd05294c26a512532d92222636 => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:24.513941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:24.527746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:24.553098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc4bd7-915a-4089-99aa-600eedb0ec46 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:24.749735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba1e8-1a60-4fa9-a21f-67b03d5a493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:24.750424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba1e8-1a60-4fa9-a21f-67b03d5a493d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:24.750732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba1e8-1a60-4fa9-a21f-67b03d5a493d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:24.751004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba1e8-1a60-4fa9-a21f-67b03d5a493d admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:24.751752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba1e8-1a60-4fa9-a21f-67b03d5a493d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:24.752055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba1e8-1a60-4fa9-a21f-67b03d5a493d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:24.753706 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba1e8-1a60-4fa9-a21f-67b03d5a493d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:24.804984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 862/1695] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:24.806390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39ea6f-60fe-4ed9-9b6b-eff78dd3cfa3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:24.813507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365c94-e4c8-4728-9364-6d39b0202057 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:24.813877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365c94-e4c8-4728-9364-6d39b0202057 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:24.814162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365c94-e4c8-4728-9364-6d39b0202057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:24.824967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:24.828735 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:24.829874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:24.830616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] PATH_INFO: `/v3/projects/84c50d971c504690aab3eaecbaad3b64` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:24.834801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c50d971c504690aab3eaecbaad3b64)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:24.845892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:24.859974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-00365c94-e4c8-4728-9364-6d39b0202057 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:24.860969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-00365c94-e4c8-4728-9364-6d39b0202057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:24.890303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 863/1696] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:24.892399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba4a2-42b7-49ff-b25d-b4aec59d5584 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:24.893953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba4a2-42b7-49ff-b25d-b4aec59d5584 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:24.895324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ba4a2-42b7-49ff-b25d-b4aec59d5584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:24.946655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-238ba4a2-42b7-49ff-b25d-b4aec59d5584 None None] MFA Rules not processed for user `55ae75b130bf4a38a81d48b87c14a464`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:24.948115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-238ba4a2-42b7-49ff-b25d-b4aec59d5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:25.119519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 864/1697] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:24 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:25.120695 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ba4a2-42b7-49ff-b25d-b4aec59d5584 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:25.123599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-238ba4a2-42b7-49ff-b25d-b4aec59d5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:25.167608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ba4a2-42b7-49ff-b25d-b4aec59d5584 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:25.170818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c50d971c504690aab3eaecbaad3b64', 'request_id': 'req-ffb3f86d-e613-4bb1-938b-7908d0d487d0'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:25.299421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:25.299421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:25.299421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:25.299421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:25.299913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:25.303081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:25.666442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c50d971c504690aab3eaecbaad3b64', 'request_id': 'req-ffb3f86d-e613-4bb1-938b-7908d0d487d0'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:25.675860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c50d971c504690aab3eaecbaad3b64', 'request_id': 'req-ffb3f86d-e613-4bb1-938b-7908d0d487d0'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:25.707082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] The token cache is being invalidate because project 84c50d971c504690aab3eaecbaad3b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:25.707816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:25.710746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:25.714086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 834/1698] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:24 2021] DELETE /identity/v3/projects/84c50d971c504690aab3eaecbaad3b64 => generated 0 bytes in 1201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:25.715680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:25.720321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:25.762566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 865/1699] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:25 2021] POST /identity/v3/projects => generated 405 bytes in 642 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:25.763506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:25.769867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:25.880629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3f86d-e613-4bb1-938b-7908d0d487d0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:25.906370 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324763d-dc9e-4460-be41-6d3426507ddb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:25.938905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:25.940232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:25.940232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:25.940551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] PATH_INFO: `/v3/projects/d6e00c3820f4483e8ed58ea833622a06` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:25.952711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e00c3820f4483e8ed58ea833622a06)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:25.958733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:25.995725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4f84-d814-4c3d-b19c-4a785c02d998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:25.997102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4f84-d814-4c3d-b19c-4a785c02d998 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:25.997567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4f84-d814-4c3d-b19c-4a785c02d998 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:25.998177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4f84-d814-4c3d-b19c-4a785c02d998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:26.000360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-698a4f84-d814-4c3d-b19c-4a785c02d998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:26.020454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4f84-d814-4c3d-b19c-4a785c02d998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:26.026139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4f84-d814-4c3d-b19c-4a785c02d998 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:26.040959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 835/1700] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:26.042869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14346c3-f049-4220-ba9e-c5b85fab79dc None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:26.043427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14346c3-f049-4220-ba9e-c5b85fab79dc None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:26.053280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14346c3-f049-4220-ba9e-c5b85fab79dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:26.091639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a14346c3-f049-4220-ba9e-c5b85fab79dc None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:26.093082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a14346c3-f049-4220-ba9e-c5b85fab79dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:26.118904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 836/1701] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:26.129292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14346c3-f049-4220-ba9e-c5b85fab79dc None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:26.136074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a14346c3-f049-4220-ba9e-c5b85fab79dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:26.158315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14346c3-f049-4220-ba9e-c5b85fab79dc None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:26.168295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:26.169184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:26.169465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:26.170194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] PATH_INFO: `/v3/projects/c1b1c9fcde6f43aebc661f303149f3e6` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:26.171402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b1c9fcde6f43aebc661f303149f3e6)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:26.173498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:26.253111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e00c3820f4483e8ed58ea833622a06', 'request_id': 'req-45d90d76-b378-43f0-9077-d4362d346c0f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.396750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e00c3820f4483e8ed58ea833622a06', 'request_id': 'req-45d90d76-b378-43f0-9077-d4362d346c0f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.405058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e00c3820f4483e8ed58ea833622a06', 'request_id': 'req-45d90d76-b378-43f0-9077-d4362d346c0f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.436892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b1c9fcde6f43aebc661f303149f3e6', 'request_id': 'req-678149f3-027f-400e-afe6-800cc1ac9f75'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.447576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] The token cache is being invalidate because project d6e00c3820f4483e8ed58ea833622a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:26.450217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.451923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.457341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 866/1702] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:25 2021] DELETE /identity/v3/projects/d6e00c3820f4483e8ed58ea833622a06 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:26.457341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:26.468540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:26.614598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90d76-b378-43f0-9077-d4362d346c0f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:26.749579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b1c9fcde6f43aebc661f303149f3e6', 'request_id': 'req-678149f3-027f-400e-afe6-800cc1ac9f75'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.757109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b1c9fcde6f43aebc661f303149f3e6', 'request_id': 'req-678149f3-027f-400e-afe6-800cc1ac9f75'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.788822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] The token cache is being invalidate because project c1b1c9fcde6f43aebc661f303149f3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:26.789470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.790344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-678149f3-027f-400e-afe6-800cc1ac9f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:26.792300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 837/1703] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:26 2021] DELETE /identity/v3/projects/c1b1c9fcde6f43aebc661f303149f3e6 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:26.793951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d0ab-33b0-4c8c-be21-63cb2d6dc564 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:26.794529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d0ab-33b0-4c8c-be21-63cb2d6dc564 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:26.795026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334d0ab-33b0-4c8c-be21-63cb2d6dc564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:26.798500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84b8e2-7e24-49ea-a781-236f3f602938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:26.800012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84b8e2-7e24-49ea-a781-236f3f602938 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:26.800538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84b8e2-7e24-49ea-a781-236f3f602938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:26.800987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84b8e2-7e24-49ea-a781-236f3f602938 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:26.801934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84b8e2-7e24-49ea-a781-236f3f602938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:26.805962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84b8e2-7e24-49ea-a781-236f3f602938 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:26.833462 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-f334d0ab-33b0-4c8c-be21-63cb2d6dc564 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:26.835052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f334d0ab-33b0-4c8c-be21-63cb2d6dc564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:26.847190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 838/1704] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:26.847190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca0fe-83fc-4819-8a10-920302c47b36 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:26.847190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca0fe-83fc-4819-8a10-920302c47b36 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:26.847190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca0fe-83fc-4819-8a10-920302c47b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:26.875479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-0aaca0fe-83fc-4819-8a10-920302c47b36 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:26.881144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0aaca0fe-83fc-4819-8a10-920302c47b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:26.887898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 839/1705] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:26.895486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514d96-0196-49e5-9cb5-a5d73cd99b5d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:26.895851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514d96-0196-49e5-9cb5-a5d73cd99b5d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:26.896191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514d96-0196-49e5-9cb5-a5d73cd99b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:26.921086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4c514d96-0196-49e5-9cb5-a5d73cd99b5d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:26.922516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4c514d96-0196-49e5-9cb5-a5d73cd99b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:26.960420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 840/1706] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:26.961900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514d96-0196-49e5-9cb5-a5d73cd99b5d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:26.973626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 867/1707] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:26 2021] POST /identity/v3/users => generated 303 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:26.978787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a85f-15c1-4fb8-bbfc-be5c0190e82c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:26.979861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a85f-15c1-4fb8-bbfc-be5c0190e82c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:26.980441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a85f-15c1-4fb8-bbfc-be5c0190e82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.017238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514d96-0196-49e5-9cb5-a5d73cd99b5d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.023300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b565a85f-15c1-4fb8-bbfc-be5c0190e82c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:27.024939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b565a85f-15c1-4fb8-bbfc-be5c0190e82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:27.038627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 868/1708] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:27.040234 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c6ab5-0a30-4e41-83a0-5b8cc9b79060 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.040688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c6ab5-0a30-4e41-83a0-5b8cc9b79060 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.041126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c6ab5-0a30-4e41-83a0-5b8cc9b79060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.063856 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3d8c6ab5-0a30-4e41-83a0-5b8cc9b79060 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:27.064223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.065065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.065400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.065495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3d8c6ab5-0a30-4e41-83a0-5b8cc9b79060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:27.065833 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.066741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:27.069507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.072900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:27.080195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 869/1709] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:27.080195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c6ab5-0a30-4e41-83a0-5b8cc9b79060 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:27.081437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3d8c6ab5-0a30-4e41-83a0-5b8cc9b79060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:27.100089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c6ab5-0a30-4e41-83a0-5b8cc9b79060 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.106684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 841/1710] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:27.107549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:27.110800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6b678-909e-4eb0-89dd-f3292df61f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.112139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6b678-909e-4eb0-89dd-f3292df61f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.112332 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6b678-909e-4eb0-89dd-f3292df61f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.112597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6b678-909e-4eb0-89dd-f3292df61f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.113354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6b678-909e-4eb0-89dd-f3292df61f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.115292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6b678-909e-4eb0-89dd-f3292df61f91 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:27.128529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 870/1711] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:27 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:27.130246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6b678-909e-4eb0-89dd-f3292df61f91 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:27.149747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733675b-5e54-4834-bd6a-84e07bed5d21 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.155243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6b678-909e-4eb0-89dd-f3292df61f91 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.165498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.166741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.167125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.167604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.168473 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:27.168872 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.171075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:27.171956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.175154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.175945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.182474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.185245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:27.191229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.195998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:27.226239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 842/1712] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:27.227700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:27.248213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895bb68-ac53-4e2d-8799-9beaa6cbdf22 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.261111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72754d0-c3ff-4a71-a94e-f95549a92024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.264086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72754d0-c3ff-4a71-a94e-f95549a92024 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.264598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72754d0-c3ff-4a71-a94e-f95549a92024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.265006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72754d0-c3ff-4a71-a94e-f95549a92024 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.265861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 871/1713] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:27.266900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:27.275066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72754d0-c3ff-4a71-a94e-f95549a92024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.281345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72754d0-c3ff-4a71-a94e-f95549a92024 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:27.290027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ad125-1f62-4325-b587-5c6e23209518 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.300995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2279022-319a-4d82-b078-6e6ad961f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.301678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2279022-319a-4d82-b078-6e6ad961f9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.301961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2279022-319a-4d82-b078-6e6ad961f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.302233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2279022-319a-4d82-b078-6e6ad961f9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.303222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2279022-319a-4d82-b078-6e6ad961f9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.304817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2279022-319a-4d82-b078-6e6ad961f9c3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:27.318416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 872/1714] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:27 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:27.319506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2279022-319a-4d82-b078-6e6ad961f9c3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:27.350796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2279022-319a-4d82-b078-6e6ad961f9c3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.372268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0794c-2c63-451e-aa2d-77aff5648358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.373129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0794c-2c63-451e-aa2d-77aff5648358 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.373425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0794c-2c63-451e-aa2d-77aff5648358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.373632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0794c-2c63-451e-aa2d-77aff5648358 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.374285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0794c-2c63-451e-aa2d-77aff5648358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.376250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0794c-2c63-451e-aa2d-77aff5648358 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:27.500242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 843/1715] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:27 2021] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:27.500242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72754d0-c3ff-4a71-a94e-f95549a92024 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:27.528636 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 873/1716] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:27 2021] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:27.530071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796374-568b-4526-a31e-41b21438d331 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.530516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796374-568b-4526-a31e-41b21438d331 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.530967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796374-568b-4526-a31e-41b21438d331 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.533245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 874/1717] 10.222.0.16 () {54 vars in 921 bytes} [Thu Nov 11 17:14:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:14:27.534208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40796374-568b-4526-a31e-41b21438d331 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:27.644976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72754d0-c3ff-4a71-a94e-f95549a92024 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.683468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40796374-568b-4526-a31e-41b21438d331 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:27.694281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc210db4-f55e-4fd0-9dc8-947eee7e527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.697557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc210db4-f55e-4fd0-9dc8-947eee7e527d admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.698305 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc210db4-f55e-4fd0-9dc8-947eee7e527d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.698717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc210db4-f55e-4fd0-9dc8-947eee7e527d admin admin] PATH_INFO: `/v3/projects/e6b47d8591164518910db57d1c21bbc1/users/d329d32ec60f44179cd3dbc8ae8b3f6d/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.748354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc210db4-f55e-4fd0-9dc8-947eee7e527d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b47d8591164518910db57d1c21bbc1, user_id=d329d32ec60f44179cd3dbc8ae8b3f6d, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.754635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc210db4-f55e-4fd0-9dc8-947eee7e527d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:27.778955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d243-f469-434c-9993-67efa7661abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:27.781519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d243-f469-434c-9993-67efa7661abb admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:27.782082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d243-f469-434c-9993-67efa7661abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:27.782508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d243-f469-434c-9993-67efa7661abb admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:27.783427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d243-f469-434c-9993-67efa7661abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:27.785530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d243-f469-434c-9993-67efa7661abb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:28.076828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 844/1719] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:27 2021] POST /identity/v3/projects => generated 369 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:28.076828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d243-f469-434c-9993-67efa7661abb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:28.083238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 875/1719] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:27 2021] PUT /identity/v3/projects/e6b47d8591164518910db57d1c21bbc1/users/d329d32ec60f44179cd3dbc8ae8b3f6d/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:28.084363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc210db4-f55e-4fd0-9dc8-947eee7e527d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:28.296307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d243-f469-434c-9993-67efa7661abb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:28.296307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:28.296307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:28.296307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:28.297963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:28.297963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:28.297963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:28.299033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc210db4-f55e-4fd0-9dc8-947eee7e527d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:28.299033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf03766-f0a2-4fe3-b9a7-dba521b00306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:28.299033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf03766-f0a2-4fe3-b9a7-dba521b00306 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:28.299033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf03766-f0a2-4fe3-b9a7-dba521b00306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:28.299677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf03766-f0a2-4fe3-b9a7-dba521b00306 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:28.299677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf03766-f0a2-4fe3-b9a7-dba521b00306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:28.299677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf03766-f0a2-4fe3-b9a7-dba521b00306 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:28.563693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 876/1721] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:28 2021] POST /identity/v3/users => generated 288 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:28.563915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 845/1721] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:28 2021] POST /identity/v3/users => generated 293 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:28.564942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:28.565557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e8973-a978-4849-a458-90f234db7411 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:28.565872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e8973-a978-4849-a458-90f234db7411 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:28.566151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e8973-a978-4849-a458-90f234db7411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:28.572832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:28.620755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a47edb-40a0-4070-9d3a-7ca66711eba5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:28.629963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-027e8973-a978-4849-a458-90f234db7411 None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:28.634468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:28.635460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:28.635783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:28.636147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] PATH_INFO: `/v3/projects/8986096a5559469682c7b91b20a2f70f` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:28.637197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-027e8973-a978-4849-a458-90f234db7411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:28.639671 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8986096a5559469682c7b91b20a2f70f)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:28.652785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:28.745111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 877/1722] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Nov 11 17:14:28 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:28.753713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e8973-a978-4849-a458-90f234db7411 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:28.757385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e8973-a978-4849-a458-90f234db7411 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:28.762596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe062cad-7e46-4342-b87e-4295e3159786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:28.763475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062cad-7e46-4342-b87e-4295e3159786 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:28.763754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062cad-7e46-4342-b87e-4295e3159786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:28.764193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062cad-7e46-4342-b87e-4295e3159786 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:28.764979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe062cad-7e46-4342-b87e-4295e3159786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:28.766934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe062cad-7e46-4342-b87e-4295e3159786 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:28.871829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8986096a5559469682c7b91b20a2f70f', 'request_id': 'req-bf297a78-4b3c-4a7e-bf73-863032baae18'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:28.930844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 878/1723] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:28 2021] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:28.930844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863d42f-d3d2-4db5-87d7-fd4de4bf18a8 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:28.930844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863d42f-d3d2-4db5-87d7-fd4de4bf18a8 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:28.930844 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863d42f-d3d2-4db5-87d7-fd4de4bf18a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:28.950835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8986096a5559469682c7b91b20a2f70f', 'request_id': 'req-bf297a78-4b3c-4a7e-bf73-863032baae18'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:28.967978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8986096a5559469682c7b91b20a2f70f', 'request_id': 'req-bf297a78-4b3c-4a7e-bf73-863032baae18'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:28.971197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4863d42f-d3d2-4db5-87d7-fd4de4bf18a8 None None] MFA Rules not processed for user `d329d32ec60f44179cd3dbc8ae8b3f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:28.972853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4863d42f-d3d2-4db5-87d7-fd4de4bf18a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:28.983088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] The token cache is being invalidate because project 8986096a5559469682c7b91b20a2f70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:28.983376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:28.984576 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:28.990291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 846/1724] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:28 2021] DELETE /identity/v3/projects/8986096a5559469682c7b91b20a2f70f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:28.991953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:28.995259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.081870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 879/1725] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:28 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:29.184400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863d42f-d3d2-4db5-87d7-fd4de4bf18a8 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.184400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4863d42f-d3d2-4db5-87d7-fd4de4bf18a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.185699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297a78-4b3c-4a7e-bf73-863032baae18 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.186251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863d42f-d3d2-4db5-87d7-fd4de4bf18a8 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.186334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.186334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.186334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.186334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.186634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.186634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.186777 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.186847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.186847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.186847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.187040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.187110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.187110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 880/1726] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:29.187110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.187297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 847/1727] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:29.187362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.187446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.187446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.187446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d02652-9056-4b34-a696-ca2a7741c996 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.187696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60b30e-fb3e-4ed7-9fad-ddec8d1ef397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.187696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60b30e-fb3e-4ed7-9fad-ddec8d1ef397 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.187696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60b30e-fb3e-4ed7-9fad-ddec8d1ef397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.187696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60b30e-fb3e-4ed7-9fad-ddec8d1ef397 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.187948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60b30e-fb3e-4ed7-9fad-ddec8d1ef397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.187948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60b30e-fb3e-4ed7-9fad-ddec8d1ef397 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.187948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 848/1728] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:29.187948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3efe0-8913-4045-8d38-0dbc6d9f9877 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.187948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3efe0-8913-4045-8d38-0dbc6d9f9877 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.187948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3efe0-8913-4045-8d38-0dbc6d9f9877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.210870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-55e3efe0-8913-4045-8d38-0dbc6d9f9877 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:29.213196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-55e3efe0-8913-4045-8d38-0dbc6d9f9877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.223524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 849/1729] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:29.225334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3efe0-8913-4045-8d38-0dbc6d9f9877 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.228190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-55e3efe0-8913-4045-8d38-0dbc6d9f9877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.246134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3efe0-8913-4045-8d38-0dbc6d9f9877 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.255587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfefac0-3633-4c4c-8d9b-a6f784fcb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.256381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfefac0-3633-4c4c-8d9b-a6f784fcb1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.256950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfefac0-3633-4c4c-8d9b-a6f784fcb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.256950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfefac0-3633-4c4c-8d9b-a6f784fcb1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.257802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfefac0-3633-4c4c-8d9b-a6f784fcb1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.261451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfefac0-3633-4c4c-8d9b-a6f784fcb1a8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.294507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa8c7-9351-429e-8445-d10e447b54b8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.301420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.302866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.303317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.303784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.306740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.325303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.331401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.355386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 881/1730] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:29.357515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.371246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ca34e-9440-4045-9475-2dde790e5082 service nova] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.379175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7654c-1044-4299-9467-39f94e3efae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.379868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7654c-1044-4299-9467-39f94e3efae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.380160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7654c-1044-4299-9467-39f94e3efae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.380437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7654c-1044-4299-9467-39f94e3efae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.382261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7654c-1044-4299-9467-39f94e3efae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.384619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7654c-1044-4299-9467-39f94e3efae0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.397177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 882/1731] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:29.399591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7654c-1044-4299-9467-39f94e3efae0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.409572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7654c-1044-4299-9467-39f94e3efae0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.416196 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef902e77-2bc4-4bf5-be02-2aa30a5c6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.418264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef902e77-2bc4-4bf5-be02-2aa30a5c6842 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.418574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef902e77-2bc4-4bf5-be02-2aa30a5c6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.418995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef902e77-2bc4-4bf5-be02-2aa30a5c6842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.422573 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef902e77-2bc4-4bf5-be02-2aa30a5c6842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.422573 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef902e77-2bc4-4bf5-be02-2aa30a5c6842 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.437356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 883/1732] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:29.437356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef902e77-2bc4-4bf5-be02-2aa30a5c6842 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.447365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef902e77-2bc4-4bf5-be02-2aa30a5c6842 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.468396 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a747710-7281-40d5-9b18-0ac4c5369fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.470009 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747710-7281-40d5-9b18-0ac4c5369fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.470503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747710-7281-40d5-9b18-0ac4c5369fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.470941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a747710-7281-40d5-9b18-0ac4c5369fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.471668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a747710-7281-40d5-9b18-0ac4c5369fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.473317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a747710-7281-40d5-9b18-0ac4c5369fc3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.497171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 884/1733] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:29 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:29.497171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fdc07-79de-408e-993a-ea2f69932b88 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.497171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fdc07-79de-408e-993a-ea2f69932b88 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.497171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fdc07-79de-408e-993a-ea2f69932b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.516030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 850/1734] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:29 2021] POST /identity/v3/projects => generated 403 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:29.523574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfefac0-3633-4c4c-8d9b-a6f784fcb1a8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.549122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-120fdc07-79de-408e-993a-ea2f69932b88 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:29.553666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-120fdc07-79de-408e-993a-ea2f69932b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.691070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 885/1735] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:29.692611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fdc07-79de-408e-993a-ea2f69932b88 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.718910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfefac0-3633-4c4c-8d9b-a6f784fcb1a8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.723275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fdc07-79de-408e-993a-ea2f69932b88 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:29.730474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18282e46-675f-494d-afbd-91b4977b1493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.733323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282e46-675f-494d-afbd-91b4977b1493 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.737695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282e46-675f-494d-afbd-91b4977b1493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.737984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18282e46-675f-494d-afbd-91b4977b1493 admin admin] PATH_INFO: `/v3/projects/4e0fbb81579b40d792c40826ae506016/users/4fc8f96ac70b482dade4022f7f05815f/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.738727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c539bd-663c-4a55-b6ab-9f03a8fe6758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:29.739821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c539bd-663c-4a55-b6ab-9f03a8fe6758 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.740243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c539bd-663c-4a55-b6ab-9f03a8fe6758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.740663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c539bd-663c-4a55-b6ab-9f03a8fe6758 admin admin] PATH_INFO: `/v3/projects/3887d29f52f04dbfb19e13cdfbbc27fb/users/b2d07ca8f138459c982cd9e6e00acc4f/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.776940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c539bd-663c-4a55-b6ab-9f03a8fe6758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3887d29f52f04dbfb19e13cdfbbc27fb, user_id=b2d07ca8f138459c982cd9e6e00acc4f, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.780070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c539bd-663c-4a55-b6ab-9f03a8fe6758 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.790376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18282e46-675f-494d-afbd-91b4977b1493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0fbb81579b40d792c40826ae506016, user_id=4fc8f96ac70b482dade4022f7f05815f, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:29.797392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18282e46-675f-494d-afbd-91b4977b1493 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:29.874725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 886/1736] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:29 2021] PUT /identity/v3/projects/3887d29f52f04dbfb19e13cdfbbc27fb/users/b2d07ca8f138459c982cd9e6e00acc4f/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:29.874725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c539bd-663c-4a55-b6ab-9f03a8fe6758 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:29.894615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 851/1737] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:29 2021] PUT /identity/v3/projects/4e0fbb81579b40d792c40826ae506016/users/4fc8f96ac70b482dade4022f7f05815f/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:29.896362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cea8d-bed4-4acc-adfb-31057f1441ce None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:29.896756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cea8d-bed4-4acc-adfb-31057f1441ce None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:29.897513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cea8d-bed4-4acc-adfb-31057f1441ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:29.938618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b25cea8d-bed4-4acc-adfb-31057f1441ce None None] MFA Rules not processed for user `cce6286edfa545718b20566887102f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:29.940507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b25cea8d-bed4-4acc-adfb-31057f1441ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:29.977729 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c539bd-663c-4a55-b6ab-9f03a8fe6758 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:30.006524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 852/1738] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:29 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:30.007596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cea8d-bed4-4acc-adfb-31057f1441ce None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:30.053808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be03ac-67dc-425e-a7b4-c0afb26296e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:30.054884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be03ac-67dc-425e-a7b4-c0afb26296e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.056296 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be03ac-67dc-425e-a7b4-c0afb26296e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.056618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be03ac-67dc-425e-a7b4-c0afb26296e0 admin admin] PATH_INFO: `/v3/projects/8b7dc78018744605a3377c1cc03a48d8/users/aa4431fec3da4a87877d5d29709e3fb2/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.083608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be03ac-67dc-425e-a7b4-c0afb26296e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7dc78018744605a3377c1cc03a48d8, user_id=aa4431fec3da4a87877d5d29709e3fb2, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:30.086351 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be03ac-67dc-425e-a7b4-c0afb26296e0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:30.116702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cea8d-bed4-4acc-adfb-31057f1441ce None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:30.121276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089f24a-7428-4f6b-add0-6e88c4f5a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:30.121993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f24a-7428-4f6b-add0-6e88c4f5a12b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.122314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f24a-7428-4f6b-add0-6e88c4f5a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.122624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f24a-7428-4f6b-add0-6e88c4f5a12b admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.123353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089f24a-7428-4f6b-add0-6e88c4f5a12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:30.125721 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089f24a-7428-4f6b-add0-6e88c4f5a12b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:30.196780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 887/1739] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:29 2021] PUT /identity/v3/projects/8b7dc78018744605a3377c1cc03a48d8/users/aa4431fec3da4a87877d5d29709e3fb2/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:30.202478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be03ac-67dc-425e-a7b4-c0afb26296e0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:30.239763 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 853/1740] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/users => generated 308 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:30.245459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da24db-c1f9-4124-8e42-b722503b5a7b None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.245459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da24db-c1f9-4124-8e42-b722503b5a7b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.245459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da24db-c1f9-4124-8e42-b722503b5a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.275941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-88da24db-c1f9-4124-8e42-b722503b5a7b None None] MFA Rules not processed for user `4fc8f96ac70b482dade4022f7f05815f`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:30.277474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-88da24db-c1f9-4124-8e42-b722503b5a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:30.289126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be03ac-67dc-425e-a7b4-c0afb26296e0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:30.296354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edec464-4e18-4e27-98a7-237395672ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:30.304830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edec464-4e18-4e27-98a7-237395672ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.304830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edec464-4e18-4e27-98a7-237395672ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.304830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edec464-4e18-4e27-98a7-237395672ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.304830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edec464-4e18-4e27-98a7-237395672ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:30.304830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edec464-4e18-4e27-98a7-237395672ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:30.304830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edec464-4e18-4e27-98a7-237395672ed4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:30.313646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 888/1741] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:30.314992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4f5e-df03-4884-a1fd-d02f7c3895e1 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.315282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4f5e-df03-4884-a1fd-d02f7c3895e1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.315561 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4f5e-df03-4884-a1fd-d02f7c3895e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.366664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-f0bd4f5e-df03-4884-a1fd-d02f7c3895e1 None None] MFA Rules not processed for user `b2d07ca8f138459c982cd9e6e00acc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:30.386840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f0bd4f5e-df03-4884-a1fd-d02f7c3895e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:30.387028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 854/1742] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:30.387028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c40d-d718-41e3-90d3-3f5d6f493536 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.387028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c40d-d718-41e3-90d3-3f5d6f493536 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.387028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3c40d-d718-41e3-90d3-3f5d6f493536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.420966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-94c3c40d-d718-41e3-90d3-3f5d6f493536 None None] MFA Rules not processed for user `aa4431fec3da4a87877d5d29709e3fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:30.422459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-94c3c40d-d718-41e3-90d3-3f5d6f493536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:30.490727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 889/1743] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:30.491912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4f5e-df03-4884-a1fd-d02f7c3895e1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:30.508098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4f5e-df03-4884-a1fd-d02f7c3895e1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:30.515426 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36365593-469f-496f-8c3a-f7bd1f2c051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:30.516137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365593-469f-496f-8c3a-f7bd1f2c051b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.516403 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365593-469f-496f-8c3a-f7bd1f2c051b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.516681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365593-469f-496f-8c3a-f7bd1f2c051b admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.517427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36365593-469f-496f-8c3a-f7bd1f2c051b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:30.519104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36365593-469f-496f-8c3a-f7bd1f2c051b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:30.531846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 890/1744] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:30.533405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36365593-469f-496f-8c3a-f7bd1f2c051b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:30.535378 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 855/1745] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:30.536216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3c40d-d718-41e3-90d3-3f5d6f493536 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:30.548962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3c40d-d718-41e3-90d3-3f5d6f493536 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:30.552719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36365593-469f-496f-8c3a-f7bd1f2c051b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:30.553620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e07ef-6928-487c-bce0-cb1d381d3809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:30.554316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e07ef-6928-487c-bce0-cb1d381d3809 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.554623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e07ef-6928-487c-bce0-cb1d381d3809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.554928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e07ef-6928-487c-bce0-cb1d381d3809 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.556140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e07ef-6928-487c-bce0-cb1d381d3809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:30.558029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e07ef-6928-487c-bce0-cb1d381d3809 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:30.558782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39558-d548-4294-a30d-b71d202cdd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:30.559473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39558-d548-4294-a30d-b71d202cdd35 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.559758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39558-d548-4294-a30d-b71d202cdd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.560034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39558-d548-4294-a30d-b71d202cdd35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.561021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c39558-d548-4294-a30d-b71d202cdd35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:30.563216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c39558-d548-4294-a30d-b71d202cdd35 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:30.659502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 891/1746] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:30.660519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39558-d548-4294-a30d-b71d202cdd35 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:30.691180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 856/1747] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:30.691180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e07ef-6928-487c-bce0-cb1d381d3809 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:30.761480 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39558-d548-4294-a30d-b71d202cdd35 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:30.808866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e07ef-6928-487c-bce0-cb1d381d3809 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:30.820131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc19994-81dd-459c-8889-48abf27295ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:30.821203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc19994-81dd-459c-8889-48abf27295ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.821508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc19994-81dd-459c-8889-48abf27295ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.821763 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc19994-81dd-459c-8889-48abf27295ea admin admin] PATH_INFO: `/v3/projects/22a764d11a6a4e1498e0a93e5fc2dc3c/users/95d7980a758f4e108d606da12457cfe6/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.842850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc19994-81dd-459c-8889-48abf27295ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a764d11a6a4e1498e0a93e5fc2dc3c, user_id=95d7980a758f4e108d606da12457cfe6, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:30.845575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc19994-81dd-459c-8889-48abf27295ea admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:30.854308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ae8c9-9605-4ef0-9169-a04195235daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:30.855287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ae8c9-9605-4ef0-9169-a04195235daf admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:30.855571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ae8c9-9605-4ef0-9169-a04195235daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:30.855946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ae8c9-9605-4ef0-9169-a04195235daf admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:30.856555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ae8c9-9605-4ef0-9169-a04195235daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:30.858530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ae8c9-9605-4ef0-9169-a04195235daf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:30.981183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 857/1748] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:30 2021] PUT /identity/v3/projects/22a764d11a6a4e1498e0a93e5fc2dc3c/users/95d7980a758f4e108d606da12457cfe6/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:30.983806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc19994-81dd-459c-8889-48abf27295ea admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:30.983902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 892/1749] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/projects => generated 387 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:30.983902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ae8c9-9605-4ef0-9169-a04195235daf admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.178677 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc19994-81dd-459c-8889-48abf27295ea admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.200871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ae8c9-9605-4ef0-9169-a04195235daf admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.216976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e0c29-87f1-4271-b5a9-5838e1ad30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.217830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0c29-87f1-4271-b5a9-5838e1ad30e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.218178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0c29-87f1-4271-b5a9-5838e1ad30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.218520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0c29-87f1-4271-b5a9-5838e1ad30e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.219450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e0c29-87f1-4271-b5a9-5838e1ad30e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.221677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e0c29-87f1-4271-b5a9-5838e1ad30e4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.264888 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27433474-17d1-441e-a9f3-67d3b2e3f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.265639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433474-17d1-441e-a9f3-67d3b2e3f248 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.265919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433474-17d1-441e-a9f3-67d3b2e3f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.266211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433474-17d1-441e-a9f3-67d3b2e3f248 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.266941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27433474-17d1-441e-a9f3-67d3b2e3f248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.268849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27433474-17d1-441e-a9f3-67d3b2e3f248 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.357990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 893/1750] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/users => generated 282 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:31.359013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e0c29-87f1-4271-b5a9-5838e1ad30e4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.369930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e0c29-87f1-4271-b5a9-5838e1ad30e4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.374674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de07d85-c443-44f4-ad4a-514e67ef3d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.375361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de07d85-c443-44f4-ad4a-514e67ef3d07 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.375645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de07d85-c443-44f4-ad4a-514e67ef3d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.375917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de07d85-c443-44f4-ad4a-514e67ef3d07 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.376618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de07d85-c443-44f4-ad4a-514e67ef3d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.378638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de07d85-c443-44f4-ad4a-514e67ef3d07 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.406781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 858/1751] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:30 2021] POST /identity/v3/projects => generated 369 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:31.406781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27433474-17d1-441e-a9f3-67d3b2e3f248 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.471241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27433474-17d1-441e-a9f3-67d3b2e3f248 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.476015 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fc94c-97f0-432e-bccf-7bc61c4a2b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.476741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc94c-97f0-432e-bccf-7bc61c4a2b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.477569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc94c-97f0-432e-bccf-7bc61c4a2b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.477569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc94c-97f0-432e-bccf-7bc61c4a2b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.478302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fc94c-97f0-432e-bccf-7bc61c4a2b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.480148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fc94c-97f0-432e-bccf-7bc61c4a2b70 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.490689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 859/1752] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:31 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:31.491500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fc94c-97f0-432e-bccf-7bc61c4a2b70 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.503308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 894/1753] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:31 2021] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:31.509284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fc94c-97f0-432e-bccf-7bc61c4a2b70 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.509406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de07d85-c443-44f4-ad4a-514e67ef3d07 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.512896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88c6c2-dc62-40e4-a86d-cc25d83722e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.513805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c6c2-dc62-40e4-a86d-cc25d83722e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.517118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c6c2-dc62-40e4-a86d-cc25d83722e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.517118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88c6c2-dc62-40e4-a86d-cc25d83722e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.517118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88c6c2-dc62-40e4-a86d-cc25d83722e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.517413 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de07d85-c443-44f4-ad4a-514e67ef3d07 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.520165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dea2c1-ee2a-46b8-92b2-4b4eacd75687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.520841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea2c1-ee2a-46b8-92b2-4b4eacd75687 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.521124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea2c1-ee2a-46b8-92b2-4b4eacd75687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.521398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea2c1-ee2a-46b8-92b2-4b4eacd75687 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.522051 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88c6c2-dc62-40e4-a86d-cc25d83722e1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.522163 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dea2c1-ee2a-46b8-92b2-4b4eacd75687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.523781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dea2c1-ee2a-46b8-92b2-4b4eacd75687 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.538794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 895/1754] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:31.538794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dea2c1-ee2a-46b8-92b2-4b4eacd75687 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.549999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dea2c1-ee2a-46b8-92b2-4b4eacd75687 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.556593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f677d-c10f-4338-8505-f49d2b6ae22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.557527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f677d-c10f-4338-8505-f49d2b6ae22d admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.557893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f677d-c10f-4338-8505-f49d2b6ae22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.558288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f677d-c10f-4338-8505-f49d2b6ae22d admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.559130 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f677d-c10f-4338-8505-f49d2b6ae22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.561446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f677d-c10f-4338-8505-f49d2b6ae22d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.608902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 860/1755] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:31 2021] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:31.609703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88c6c2-dc62-40e4-a86d-cc25d83722e1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.619900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88c6c2-dc62-40e4-a86d-cc25d83722e1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.624679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1fde0-ca9e-4793-b6ca-ab689ee93785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.625555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1fde0-ca9e-4793-b6ca-ab689ee93785 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.625828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1fde0-ca9e-4793-b6ca-ab689ee93785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.626117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1fde0-ca9e-4793-b6ca-ab689ee93785 admin admin] PATH_INFO: `/v3/projects/22a764d11a6a4e1498e0a93e5fc2dc3c/users/95d7980a758f4e108d606da12457cfe6/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.628084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1fde0-ca9e-4793-b6ca-ab689ee93785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a764d11a6a4e1498e0a93e5fc2dc3c, user_id=95d7980a758f4e108d606da12457cfe6, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.630827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1fde0-ca9e-4793-b6ca-ab689ee93785 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.641489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 896/1756] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:31 2021] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:31.641489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f677d-c10f-4338-8505-f49d2b6ae22d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.654690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f677d-c10f-4338-8505-f49d2b6ae22d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.662066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 861/1757] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:31 2021] PUT /identity/v3/projects/22a764d11a6a4e1498e0a93e5fc2dc3c/users/95d7980a758f4e108d606da12457cfe6/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:31.671717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1fde0-ca9e-4793-b6ca-ab689ee93785 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.751024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb922-a3fa-4c74-a4d9-26e796c3a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.751693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb922-a3fa-4c74-a4d9-26e796c3a120 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.751944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb922-a3fa-4c74-a4d9-26e796c3a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.752208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fb922-a3fa-4c74-a4d9-26e796c3a120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.752947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fb922-a3fa-4c74-a4d9-26e796c3a120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.754678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fb922-a3fa-4c74-a4d9-26e796c3a120 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.760373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1fde0-ca9e-4793-b6ca-ab689ee93785 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.765339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 897/1758] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:31 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:31.768704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20eaa7-27ed-4682-bdce-0a73ced6adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.768823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb922-a3fa-4c74-a4d9-26e796c3a120 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.768923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20eaa7-27ed-4682-bdce-0a73ced6adef admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.768923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20eaa7-27ed-4682-bdce-0a73ced6adef admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.768923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20eaa7-27ed-4682-bdce-0a73ced6adef admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.768923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20eaa7-27ed-4682-bdce-0a73ced6adef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.770306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20eaa7-27ed-4682-bdce-0a73ced6adef admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.781315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 862/1759] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:31 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:31.782263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20eaa7-27ed-4682-bdce-0a73ced6adef admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.783872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fb922-a3fa-4c74-a4d9-26e796c3a120 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.789995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4faf-02a3-4419-9482-38fcf9fa650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.791021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4faf-02a3-4419-9482-38fcf9fa650e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.791713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4faf-02a3-4419-9482-38fcf9fa650e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.792219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4faf-02a3-4419-9482-38fcf9fa650e admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.793176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4faf-02a3-4419-9482-38fcf9fa650e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.795093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4faf-02a3-4419-9482-38fcf9fa650e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.797194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20eaa7-27ed-4682-bdce-0a73ced6adef admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.802884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238a636-c3b2-406c-a5f5-d948f78208b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.803587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238a636-c3b2-406c-a5f5-d948f78208b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.803870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238a636-c3b2-406c-a5f5-d948f78208b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.804142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238a636-c3b2-406c-a5f5-d948f78208b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.804904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238a636-c3b2-406c-a5f5-d948f78208b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.807111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238a636-c3b2-406c-a5f5-d948f78208b8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.814201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 898/1760] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:31 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:31.815756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e6c8-2842-401f-92a4-8869219a999d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.816150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e6c8-2842-401f-92a4-8869219a999d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.816524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e6c8-2842-401f-92a4-8869219a999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.833931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 863/1761] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:31 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:31.834855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238a636-c3b2-406c-a5f5-d948f78208b8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.849180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238a636-c3b2-406c-a5f5-d948f78208b8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:31.855066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bce99-eb25-4849-99e2-b3bc85b0b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:31.855961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bce99-eb25-4849-99e2-b3bc85b0b3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:31.856352 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bce99-eb25-4849-99e2-b3bc85b0b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:31.856632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bce99-eb25-4849-99e2-b3bc85b0b3f2 admin admin] PATH_INFO: `/v3/projects/991ca76b8052453daee096462b253aaa/users/ed545ca558134bbbb7a8c3b261f85105/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:31.857200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-66d8e6c8-2842-401f-92a4-8869219a999d None None] MFA Rules not processed for user `95d7980a758f4e108d606da12457cfe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:31.858821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-66d8e6c8-2842-401f-92a4-8869219a999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:31.873236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bce99-eb25-4849-99e2-b3bc85b0b3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991ca76b8052453daee096462b253aaa, user_id=ed545ca558134bbbb7a8c3b261f85105, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:31.876119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bce99-eb25-4849-99e2-b3bc85b0b3f2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:31.955532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 899/1762] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:31 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:31.955532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8e6c8-2842-401f-92a4-8869219a999d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.959438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 864/1763] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:31 2021] PUT /identity/v3/projects/991ca76b8052453daee096462b253aaa/users/ed545ca558134bbbb7a8c3b261f85105/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:31.960985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bce99-eb25-4849-99e2-b3bc85b0b3f2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:31.966060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8e6c8-2842-401f-92a4-8869219a999d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.044662 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bce99-eb25-4849-99e2-b3bc85b0b3f2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.046805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd88185-2f70-4ad7-b29f-6c07a7e0ba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.051059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd88185-2f70-4ad7-b29f-6c07a7e0ba7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.051059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd88185-2f70-4ad7-b29f-6c07a7e0ba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.051059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd88185-2f70-4ad7-b29f-6c07a7e0ba7e admin admin] PATH_INFO: `/v3/projects/055e07cd619b4942b18ebc536afef402/users/cc8d311f6847442e87b91d8fca62deba/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.051319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b873f8-c993-4307-ad3d-4f4ae00a9e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.051319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b873f8-c993-4307-ad3d-4f4ae00a9e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.051319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b873f8-c993-4307-ad3d-4f4ae00a9e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.051556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b873f8-c993-4307-ad3d-4f4ae00a9e23 admin admin] PATH_INFO: `/v3/projects/428887c699b74f02ba8dcdadaae833a7/users/87b3856e855849d385b00be0c0116535/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.065264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd88185-2f70-4ad7-b29f-6c07a7e0ba7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=055e07cd619b4942b18ebc536afef402, user_id=cc8d311f6847442e87b91d8fca62deba, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.067744 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b873f8-c993-4307-ad3d-4f4ae00a9e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428887c699b74f02ba8dcdadaae833a7, user_id=87b3856e855849d385b00be0c0116535, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.069136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd88185-2f70-4ad7-b29f-6c07a7e0ba7e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.070458 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b873f8-c993-4307-ad3d-4f4ae00a9e23 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.163185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 865/1764] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:31 2021] PUT /identity/v3/projects/428887c699b74f02ba8dcdadaae833a7/users/87b3856e855849d385b00be0c0116535/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:32.163882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b873f8-c993-4307-ad3d-4f4ae00a9e23 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.207995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 900/1765] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:31 2021] PUT /identity/v3/projects/055e07cd619b4942b18ebc536afef402/users/cc8d311f6847442e87b91d8fca62deba/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:32.209708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd88185-2f70-4ad7-b29f-6c07a7e0ba7e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.241395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b873f8-c993-4307-ad3d-4f4ae00a9e23 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.319358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c58b-3053-46f0-985f-f25e477e673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.320297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c58b-3053-46f0-985f-f25e477e673e admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.320685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c58b-3053-46f0-985f-f25e477e673e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.321731 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0c58b-3053-46f0-985f-f25e477e673e admin admin] PATH_INFO: `/v3/projects/de64d1633f8c4ad39cf1bcc34734a546/users/4cb5a5e2bbc542bc824f63470fbda58c/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.338417 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0c58b-3053-46f0-985f-f25e477e673e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de64d1633f8c4ad39cf1bcc34734a546, user_id=4cb5a5e2bbc542bc824f63470fbda58c, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.341222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0c58b-3053-46f0-985f-f25e477e673e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.362829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd88185-2f70-4ad7-b29f-6c07a7e0ba7e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.368466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.369157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.369436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.369703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.370456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.372105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.384214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 901/1766] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:32.388569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.390685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:32.452915 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88da5-2ec0-4ae7-a909-cf3451f91b77 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.456643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0595-68ec-4241-b639-182098c1d79d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.459223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0595-68ec-4241-b639-182098c1d79d service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.460477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0595-68ec-4241-b639-182098c1d79d service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.460477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0595-68ec-4241-b639-182098c1d79d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.468096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 866/1767] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:32 2021] PUT /identity/v3/projects/de64d1633f8c4ad39cf1bcc34734a546/users/4cb5a5e2bbc542bc824f63470fbda58c/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:32.469258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c58b-3053-46f0-985f-f25e477e673e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.531944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0595-68ec-4241-b639-182098c1d79d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.533613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0595-68ec-4241-b639-182098c1d79d service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.537300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0c58b-3053-46f0-985f-f25e477e673e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.542899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59ef8-431e-44d6-829a-592522f221c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.543660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59ef8-431e-44d6-829a-592522f221c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.544022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59ef8-431e-44d6-829a-592522f221c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.544995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b59ef8-431e-44d6-829a-592522f221c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.546151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b59ef8-431e-44d6-829a-592522f221c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.547899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b59ef8-431e-44d6-829a-592522f221c5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.554757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 902/1768] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:32 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:32.557019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfaf6f-1b9b-4b18-9371-cc9b9a88cc3b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.557116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfaf6f-1b9b-4b18-9371-cc9b9a88cc3b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.557341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfaf6f-1b9b-4b18-9371-cc9b9a88cc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.563478 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 867/1769] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:32.564458 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59ef8-431e-44d6-829a-592522f221c5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.574096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b59ef8-431e-44d6-829a-592522f221c5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.580682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d32ba-5321-4898-bed1-0e4cd3927524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.581567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d32ba-5321-4898-bed1-0e4cd3927524 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.581846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d32ba-5321-4898-bed1-0e4cd3927524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.582164 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d32ba-5321-4898-bed1-0e4cd3927524 admin admin] PATH_INFO: `/v3/projects/991ca76b8052453daee096462b253aaa/users/ed545ca558134bbbb7a8c3b261f85105/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.584345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d32ba-5321-4898-bed1-0e4cd3927524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991ca76b8052453daee096462b253aaa, user_id=ed545ca558134bbbb7a8c3b261f85105, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.587573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d32ba-5321-4898-bed1-0e4cd3927524 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.595211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3abfaf6f-1b9b-4b18-9371-cc9b9a88cc3b None None] MFA Rules not processed for user `cc8d311f6847442e87b91d8fca62deba`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:32.597173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3abfaf6f-1b9b-4b18-9371-cc9b9a88cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:32.611025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 868/1770] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:32 2021] PUT /identity/v3/projects/991ca76b8052453daee096462b253aaa/users/ed545ca558134bbbb7a8c3b261f85105/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:32.611025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d32ba-5321-4898-bed1-0e4cd3927524 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.690981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 903/1771] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:32 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:32.691968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfaf6f-1b9b-4b18-9371-cc9b9a88cc3b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.697321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d32ba-5321-4898-bed1-0e4cd3927524 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.703300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71708593-0bb9-4072-b810-3e37eb654f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.703978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708593-0bb9-4072-b810-3e37eb654f7b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.704305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708593-0bb9-4072-b810-3e37eb654f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.704716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708593-0bb9-4072-b810-3e37eb654f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.705472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71708593-0bb9-4072-b810-3e37eb654f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.707950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71708593-0bb9-4072-b810-3e37eb654f7b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.708102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfaf6f-1b9b-4b18-9371-cc9b9a88cc3b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.714250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.715067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.715353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.715629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] PATH_INFO: `/v3/projects/428887c699b74f02ba8dcdadaae833a7/users/87b3856e855849d385b00be0c0116535/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.718394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428887c699b74f02ba8dcdadaae833a7, user_id=87b3856e855849d385b00be0c0116535, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.719035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 869/1772] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:32 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:32.720996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f344-45cd-4f6e-95c5-c68c019fe4e9 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.720996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f344-45cd-4f6e-95c5-c68c019fe4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.720996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f344-45cd-4f6e-95c5-c68c019fe4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.721402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.744580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 904/1773] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:32 2021] PUT /identity/v3/projects/428887c699b74f02ba8dcdadaae833a7/users/87b3856e855849d385b00be0c0116535/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:32.744580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.744580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:32.753523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6c39f344-45cd-4f6e-95c5-c68c019fe4e9 None None] MFA Rules not processed for user `ed545ca558134bbbb7a8c3b261f85105`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:32.755869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6c39f344-45cd-4f6e-95c5-c68c019fe4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:32.806629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb76f72-f854-4466-a25a-d73e524c7f03 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.810181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447a01-df55-42f1-8d00-d5d176312100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.810860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447a01-df55-42f1-8d00-d5d176312100 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.811138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447a01-df55-42f1-8d00-d5d176312100 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.811410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447a01-df55-42f1-8d00-d5d176312100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.831180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 870/1774] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:32 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:32.832118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f344-45cd-4f6e-95c5-c68c019fe4e9 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:32.870792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34447a01-df55-42f1-8d00-d5d176312100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.872240 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34447a01-df55-42f1-8d00-d5d176312100 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.881476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 905/1775] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:32 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:32.882753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86790b-4814-4beb-9a78-11d3af903a0d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.883095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86790b-4814-4beb-9a78-11d3af903a0d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.883948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86790b-4814-4beb-9a78-11d3af903a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.896191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f344-45cd-4f6e-95c5-c68c019fe4e9 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:32.900996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bee044-8b1d-4f88-9433-50d6f5b8197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:32.901887 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bee044-8b1d-4f88-9433-50d6f5b8197d admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:32.902173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bee044-8b1d-4f88-9433-50d6f5b8197d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:32.902438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bee044-8b1d-4f88-9433-50d6f5b8197d admin admin] PATH_INFO: `/v3/projects/de64d1633f8c4ad39cf1bcc34734a546/users/4cb5a5e2bbc542bc824f63470fbda58c/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:32.904449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bee044-8b1d-4f88-9433-50d6f5b8197d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de64d1633f8c4ad39cf1bcc34734a546, user_id=4cb5a5e2bbc542bc824f63470fbda58c, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:32.907105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bee044-8b1d-4f88-9433-50d6f5b8197d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:32.913107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7a86790b-4814-4beb-9a78-11d3af903a0d None None] MFA Rules not processed for user `87b3856e855849d385b00be0c0116535`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:32.914340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7a86790b-4814-4beb-9a78-11d3af903a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:32.919498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 871/1776] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:32 2021] PUT /identity/v3/projects/de64d1633f8c4ad39cf1bcc34734a546/users/4cb5a5e2bbc542bc824f63470fbda58c/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:32.920621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bee044-8b1d-4f88-9433-50d6f5b8197d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:33.007087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 906/1777] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:32 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:33.009336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bee044-8b1d-4f88-9433-50d6f5b8197d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:33.009474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86790b-4814-4beb-9a78-11d3af903a0d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:33.015059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:33.016453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:33.016453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:33.016607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] PATH_INFO: `/v3/users/d329d32ec60f44179cd3dbc8ae8b3f6d` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:33.018076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d329d32ec60f44179cd3dbc8ae8b3f6d)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:33.021064 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:33.077552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86790b-4814-4beb-9a78-11d3af903a0d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:33.081537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655472d-e06f-4f4f-9043-ce6005cd15a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:33.081829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655472d-e06f-4f4f-9043-ce6005cd15a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:33.082108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655472d-e06f-4f4f-9043-ce6005cd15a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:33.082378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655472d-e06f-4f4f-9043-ce6005cd15a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:33.136802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655472d-e06f-4f4f-9043-ce6005cd15a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:33.138280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655472d-e06f-4f4f-9043-ce6005cd15a0 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:33.148562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 907/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:33 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:33.149871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321135-dd27-434f-ab5b-9b6d2aa04872 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:33.150231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321135-dd27-434f-ab5b-9b6d2aa04872 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:33.150509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11321135-dd27-434f-ab5b-9b6d2aa04872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:33.179241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-11321135-dd27-434f-ab5b-9b6d2aa04872 None None] MFA Rules not processed for user `4cb5a5e2bbc542bc824f63470fbda58c`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:33.181152 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-11321135-dd27-434f-ab5b-9b6d2aa04872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:33.256117 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 908/1779] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:33 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:33.256863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd329d32ec60f44179cd3dbc8ae8b3f6d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:33.257309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd329d32ec60f44179cd3dbc8ae8b3f6d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:33.258014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd329d32ec60f44179cd3dbc8ae8b3f6d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:33.521646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd329d32ec60f44179cd3dbc8ae8b3f6d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:33.552851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd329d32ec60f44179cd3dbc8ae8b3f6d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:33.584641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 872/1780] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:32 2021] DELETE /identity/v3/users/d329d32ec60f44179cd3dbc8ae8b3f6d => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:33.589477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbdbb7-0e3b-49f4-83d6-9d96af9ec314 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:33.593173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbdbb7-0e3b-49f4-83d6-9d96af9ec314 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:33.593173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbdbb7-0e3b-49f4-83d6-9d96af9ec314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:33.609055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ddbbdbb7-0e3b-49f4-83d6-9d96af9ec314 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:33.610422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ddbbdbb7-0e3b-49f4-83d6-9d96af9ec314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:33.669443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 909/1781] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:33.680864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:33.685079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:33.758844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c546df-7ca4-4459-b257-7bdd07a8d7f6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:33.764779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:33.765526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:33.765895 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:33.766353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:33.779555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:33.781865 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:33.798742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 873/1782] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:33.865874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbdbb7-0e3b-49f4-83d6-9d96af9ec314 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:33.867359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ddbbdbb7-0e3b-49f4-83d6-9d96af9ec314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:33.933086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbdbb7-0e3b-49f4-83d6-9d96af9ec314 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:33.937387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:33.938060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:33.938338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:33.938664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:33.940697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:34.029316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:34.030911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:34.044256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 910/1783] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:33 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:34.046446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:34.048174 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:34.062570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d7d8f-fd97-480e-ac36-a5879338a29c service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:34.067497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:34.068492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:34.068985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:34.069366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:34.071565 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:34.176057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:34.177767 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:34.189878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 874/1784] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:34 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:34.387570 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:34.406574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753181a2-a455-4cad-a8ec-15c38fc5d1f0 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:34.412667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:34.414333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:34.414872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:34.415150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:34.417719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:34.518938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:34.520459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:34.531560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 911/1785] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:34 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:34.622725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:34.624772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:34.641851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcded0-711e-43e4-9dfc-93b48f699c55 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:34.646807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:34.647906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:34.648205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:34.648534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] PATH_INFO: `/v3/projects/e6b47d8591164518910db57d1c21bbc1` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:34.649933 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b47d8591164518910db57d1c21bbc1)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:34.651970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:34.812584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b47d8591164518910db57d1c21bbc1', 'request_id': 'req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:34.912222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b47d8591164518910db57d1c21bbc1', 'request_id': 'req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:34.927417 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b47d8591164518910db57d1c21bbc1', 'request_id': 'req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:34.933656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] The token cache is being invalidate because project e6b47d8591164518910db57d1c21bbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:34.934044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:34.934931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:34.939735 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 875/1786] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:34 2021] DELETE /identity/v3/projects/e6b47d8591164518910db57d1c21bbc1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:34.940924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:34.954821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff1840-b72b-4c3a-99fe-ec00efccaeda service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:35.033755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:35.034709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:35.035430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:35.035714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] PATH_INFO: `/v3/users/95d7980a758f4e108d606da12457cfe6` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:35.037212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d7980a758f4e108d606da12457cfe6)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:35.040118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:35.360334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d7980a758f4e108d606da12457cfe6'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:35.361505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d7980a758f4e108d606da12457cfe6'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:35.362325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d7980a758f4e108d606da12457cfe6'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:35.482078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d7980a758f4e108d606da12457cfe6'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:35.506333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d7980a758f4e108d606da12457cfe6'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:35.536097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 912/1787] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:34 2021] DELETE /identity/v3/users/95d7980a758f4e108d606da12457cfe6 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:36.515301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:36.516965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:36.533157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56f61e-a1f3-49cf-9ec3-0a79c68c98d1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:36.608031 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:36.619361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:36.619361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:36.619361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] PATH_INFO: `/v3/users/b2d07ca8f138459c982cd9e6e00acc4f` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:36.619361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d07ca8f138459c982cd9e6e00acc4f)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:36.619361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:36.775534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:36.777225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:36.795053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fa58f-3505-44da-9e2e-360857104b8a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:36.800050 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:36.801103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:36.801393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:36.801665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] PATH_INFO: `/v3/projects/22a764d11a6a4e1498e0a93e5fc2dc3c` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:36.803216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a764d11a6a4e1498e0a93e5fc2dc3c)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:36.806315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:36.906646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d07ca8f138459c982cd9e6e00acc4f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:36.907968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d07ca8f138459c982cd9e6e00acc4f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:36.908845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d07ca8f138459c982cd9e6e00acc4f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:36.933329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a764d11a6a4e1498e0a93e5fc2dc3c', 'request_id': 'req-d78bb137-fcfe-4072-8328-b402b4bbcc54'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:37.020060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d07ca8f138459c982cd9e6e00acc4f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:37.037281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d9529c4-8c8f-443d-980d-9ba3d85b697f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d07ca8f138459c982cd9e6e00acc4f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:37.052453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 876/1788] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:36 2021] DELETE /identity/v3/users/b2d07ca8f138459c982cd9e6e00acc4f => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:37.057916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48a71-04f2-4512-8c24-6561baad1161 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.058278 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48a71-04f2-4512-8c24-6561baad1161 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.058602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48a71-04f2-4512-8c24-6561baad1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.077775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d7a48a71-04f2-4512-8c24-6561baad1161 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:37.079040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d7a48a71-04f2-4512-8c24-6561baad1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:37.134062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a764d11a6a4e1498e0a93e5fc2dc3c', 'request_id': 'req-d78bb137-fcfe-4072-8328-b402b4bbcc54'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:37.140781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a764d11a6a4e1498e0a93e5fc2dc3c', 'request_id': 'req-d78bb137-fcfe-4072-8328-b402b4bbcc54'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:37.153620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] The token cache is being invalidate because project 22a764d11a6a4e1498e0a93e5fc2dc3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:37.153891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:37.154769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 877/1789] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:37.159060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d78bb137-fcfe-4072-8328-b402b4bbcc54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:37.164375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 913/1790] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:36 2021] DELETE /identity/v3/projects/22a764d11a6a4e1498e0a93e5fc2dc3c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:37.165248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48a71-04f2-4512-8c24-6561baad1161 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:37.170818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d7a48a71-04f2-4512-8c24-6561baad1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:37.176115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cf41f-4215-4224-b68b-7da5b8be516f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.177095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cf41f-4215-4224-b68b-7da5b8be516f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.177593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cf41f-4215-4224-b68b-7da5b8be516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.197576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b15cf41f-4215-4224-b68b-7da5b8be516f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:37.199037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b15cf41f-4215-4224-b68b-7da5b8be516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:37.218352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 914/1791] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:37.220043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad70f1-3311-40f0-8498-34ad38d7502a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.220661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad70f1-3311-40f0-8498-34ad38d7502a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.221180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad70f1-3311-40f0-8498-34ad38d7502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.231785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48a71-04f2-4512-8c24-6561baad1161 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:37.235954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:37.236641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.236922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.237194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.239902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:37.252355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-52ad70f1-3311-40f0-8498-34ad38d7502a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:37.252355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-52ad70f1-3311-40f0-8498-34ad38d7502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:37.255408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:37.257142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:37.263035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 915/1792] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:37.267349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad70f1-3311-40f0-8498-34ad38d7502a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:37.271724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 878/1793] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:37.276896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad70f1-3311-40f0-8498-34ad38d7502a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:37.286573 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:37.287962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.287962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.288336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.289184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:37.289622 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:37.296526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:37.314525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 916/1794] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:37.316577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:37.328140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d40ee-04ec-4eaf-8566-df13348cf150 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:37.336733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5266e5-306c-4575-8cce-a7f851d57847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:37.341349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5266e5-306c-4575-8cce-a7f851d57847 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.341349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5266e5-306c-4575-8cce-a7f851d57847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.341349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5266e5-306c-4575-8cce-a7f851d57847 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.341349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5266e5-306c-4575-8cce-a7f851d57847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:37.341349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5266e5-306c-4575-8cce-a7f851d57847 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:37.460803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 879/1795] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:37 2021] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:37.465131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:37.476944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c1c86-ed6e-41e7-83e7-0afdeb12f2ce admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:37.548577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795297-0758-44c6-a4f6-c654ec3babbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:37.549277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795297-0758-44c6-a4f6-c654ec3babbe admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.549555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795297-0758-44c6-a4f6-c654ec3babbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.549823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795297-0758-44c6-a4f6-c654ec3babbe admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.550530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36795297-0758-44c6-a4f6-c654ec3babbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:37.552498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36795297-0758-44c6-a4f6-c654ec3babbe admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:37.702119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 917/1796] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:37 2021] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:37.705674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5266e5-306c-4575-8cce-a7f851d57847 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:37.723409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5266e5-306c-4575-8cce-a7f851d57847 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:37.759818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda24225-72a8-45d5-841b-83d7c83738a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:37.760725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda24225-72a8-45d5-841b-83d7c83738a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.761141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda24225-72a8-45d5-841b-83d7c83738a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.762804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda24225-72a8-45d5-841b-83d7c83738a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.763775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda24225-72a8-45d5-841b-83d7c83738a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:37.765877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda24225-72a8-45d5-841b-83d7c83738a1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:37.780616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 880/1797] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:37.784298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795297-0758-44c6-a4f6-c654ec3babbe admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:37.796048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795297-0758-44c6-a4f6-c654ec3babbe admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:37.825823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d60255-d069-4d4a-94fb-b08d2a1b7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:37.825823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d60255-d069-4d4a-94fb-b08d2a1b7c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.825823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d60255-d069-4d4a-94fb-b08d2a1b7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.825823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d60255-d069-4d4a-94fb-b08d2a1b7c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.826302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d60255-d069-4d4a-94fb-b08d2a1b7c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:37.826302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d60255-d069-4d4a-94fb-b08d2a1b7c52 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:37.826302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 918/1798] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:37.828756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda24225-72a8-45d5-841b-83d7c83738a1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:37.844501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda24225-72a8-45d5-841b-83d7c83738a1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:37.855991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:37.857000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.857390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.857946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] PATH_INFO: `/v3/projects/f1b538b628ba44919570f912fc220e51/users/9afd59f7e16e40c3ac6990aa291b562d/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:37.878369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b538b628ba44919570f912fc220e51, user_id=9afd59f7e16e40c3ac6990aa291b562d, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:37.882924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:37.976331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 881/1799] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:37 2021] PUT /identity/v3/projects/f1b538b628ba44919570f912fc220e51/users/9afd59f7e16e40c3ac6990aa291b562d/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:37.978650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45027-52fb-4e1d-934b-a4bfcdc27971 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:37.978946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45027-52fb-4e1d-934b-a4bfcdc27971 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:37.979219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45027-52fb-4e1d-934b-a4bfcdc27971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.007285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-26a45027-52fb-4e1d-934b-a4bfcdc27971 None None] MFA Rules not processed for user `9afd59f7e16e40c3ac6990aa291b562d`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:38.008514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-26a45027-52fb-4e1d-934b-a4bfcdc27971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:38.020481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:38.022595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:38.099286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 919/1800] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:37 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:38.104365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a45027-52fb-4e1d-934b-a4bfcdc27971 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:38.138922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a08112-f64e-465c-9bfe-de46b45eb35e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:38.143931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:38.144809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.145086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.145357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] PATH_INFO: `/v3/projects/3887d29f52f04dbfb19e13cdfbbc27fb` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.146630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3887d29f52f04dbfb19e13cdfbbc27fb)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:38.148547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:38.186399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a45027-52fb-4e1d-934b-a4bfcdc27971 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:38.192989 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ca41-53f6-4992-9c35-049197a4ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:38.193698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ca41-53f6-4992-9c35-049197a4ec10 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.193981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ca41-53f6-4992-9c35-049197a4ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.194330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ca41-53f6-4992-9c35-049197a4ec10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.195161 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79ca41-53f6-4992-9c35-049197a4ec10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:38.197940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79ca41-53f6-4992-9c35-049197a4ec10 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:38.294408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3887d29f52f04dbfb19e13cdfbbc27fb', 'request_id': 'req-4aedf078-e551-4909-8f02-4c5966270817'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.312989 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 920/1801] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:38 2021] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:38.317358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ca41-53f6-4992-9c35-049197a4ec10 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:38.362074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3887d29f52f04dbfb19e13cdfbbc27fb', 'request_id': 'req-4aedf078-e551-4909-8f02-4c5966270817'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.368713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3887d29f52f04dbfb19e13cdfbbc27fb', 'request_id': 'req-4aedf078-e551-4909-8f02-4c5966270817'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.380328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] The token cache is being invalidate because project 3887d29f52f04dbfb19e13cdfbbc27fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:38.380613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.381442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.383945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 882/1802] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:38 2021] DELETE /identity/v3/projects/3887d29f52f04dbfb19e13cdfbbc27fb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:38.385998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ca41-53f6-4992-9c35-049197a4ec10 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:38.387971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:38.389467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:38.391450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:38.392203 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.392460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.392888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.393628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:38.395953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:38.458219 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf078-e551-4909-8f02-4c5966270817 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:38.463354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:38.464259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.464542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.464827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] PATH_INFO: `/v3/users/87b3856e855849d385b00be0c0116535` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.466100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b3856e855849d385b00be0c0116535)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:38.468093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:38.511158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 921/1803] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:38 2021] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:38.515774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:38.517558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:38.529665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfefaf-6b4c-4583-a7f1-54bd44bfa7d0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:38.534709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659b41-0ea7-4fbf-a6f8-aa8da7ed3341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:38.535385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659b41-0ea7-4fbf-a6f8-aa8da7ed3341 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.535682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659b41-0ea7-4fbf-a6f8-aa8da7ed3341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.535953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659b41-0ea7-4fbf-a6f8-aa8da7ed3341 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.536697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659b41-0ea7-4fbf-a6f8-aa8da7ed3341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:38.538299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659b41-0ea7-4fbf-a6f8-aa8da7ed3341 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:38.549188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 922/1804] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:38.553096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659b41-0ea7-4fbf-a6f8-aa8da7ed3341 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:38.565792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659b41-0ea7-4fbf-a6f8-aa8da7ed3341 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:38.575212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274cf5-7bd5-4518-9af6-4d52d824f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:38.575958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274cf5-7bd5-4518-9af6-4d52d824f76c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.576276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274cf5-7bd5-4518-9af6-4d52d824f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.576557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274cf5-7bd5-4518-9af6-4d52d824f76c admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.577324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274cf5-7bd5-4518-9af6-4d52d824f76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:38.579263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274cf5-7bd5-4518-9af6-4d52d824f76c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:38.590109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 923/1805] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:38.594344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274cf5-7bd5-4518-9af6-4d52d824f76c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:38.604305 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274cf5-7bd5-4518-9af6-4d52d824f76c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:38.610095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5b796-7858-4a44-9387-2b6668a17a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:38.610974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5b796-7858-4a44-9387-2b6668a17a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.611253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5b796-7858-4a44-9387-2b6668a17a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.611524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5b796-7858-4a44-9387-2b6668a17a08 admin admin] PATH_INFO: `/v3/projects/bcf3824c7bcd4e2fb0a5e44e478e8034/users/8e7f6ee57c01435eb4b631797b8f3a68/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.627115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5b796-7858-4a44-9387-2b6668a17a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf3824c7bcd4e2fb0a5e44e478e8034, user_id=8e7f6ee57c01435eb4b631797b8f3a68, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:38.629776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5b796-7858-4a44-9387-2b6668a17a08 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:38.720291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b3856e855849d385b00be0c0116535'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.721749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b3856e855849d385b00be0c0116535'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.722635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b3856e855849d385b00be0c0116535'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.725536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 924/1806] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:38 2021] PUT /identity/v3/projects/bcf3824c7bcd4e2fb0a5e44e478e8034/users/8e7f6ee57c01435eb4b631797b8f3a68/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:38.737300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec581-3f7b-445a-9272-7f51ebc49687 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.737898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec581-3f7b-445a-9272-7f51ebc49687 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.739102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec581-3f7b-445a-9272-7f51ebc49687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.785841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b3bec581-3f7b-445a-9272-7f51ebc49687 None None] MFA Rules not processed for user `8e7f6ee57c01435eb4b631797b8f3a68`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:38.787097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b3bec581-3f7b-445a-9272-7f51ebc49687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:38.790948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b3856e855849d385b00be0c0116535'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.807282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b3856e855849d385b00be0c0116535'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:38.823248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 883/1807] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:38 2021] DELETE /identity/v3/users/87b3856e855849d385b00be0c0116535 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:38.879640 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 925/1808] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:38 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:38.885167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:38.887151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:38.962514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d85b7-d959-458e-9b73-3cc884d6eff8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:38.966998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0828c-75d2-4e72-992f-c3dbd2e3840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:38.967648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0828c-75d2-4e72-992f-c3dbd2e3840c admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:38.967922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0828c-75d2-4e72-992f-c3dbd2e3840c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:38.968192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0828c-75d2-4e72-992f-c3dbd2e3840c admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:38.968886 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0828c-75d2-4e72-992f-c3dbd2e3840c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:38.970799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0828c-75d2-4e72-992f-c3dbd2e3840c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:39.058918 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 884/1809] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:38 2021] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:39.062871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bec581-3f7b-445a-9272-7f51ebc49687 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:39.157623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bec581-3f7b-445a-9272-7f51ebc49687 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:39.213493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8a92-8518-47f3-b276-69b19ef34c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:39.214171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8a92-8518-47f3-b276-69b19ef34c82 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.214452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8a92-8518-47f3-b276-69b19ef34c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.214751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8a92-8518-47f3-b276-69b19ef34c82 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:39.215451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d8a92-8518-47f3-b276-69b19ef34c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:39.217445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d8a92-8518-47f3-b276-69b19ef34c82 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:39.356534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 926/1810] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:39 2021] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:39.360566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0828c-75d2-4e72-992f-c3dbd2e3840c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:39.370632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0828c-75d2-4e72-992f-c3dbd2e3840c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:39.375235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:39.421265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.421265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.421265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:39.421265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:39.421265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:39.421265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 885/1811] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:39.424620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8a92-8518-47f3-b276-69b19ef34c82 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:39.434742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8a92-8518-47f3-b276-69b19ef34c82 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:39.439202 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10325f7d-369f-4fdf-927b-5166414a4a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:39.440075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10325f7d-369f-4fdf-927b-5166414a4a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.440468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10325f7d-369f-4fdf-927b-5166414a4a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.441790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10325f7d-369f-4fdf-927b-5166414a4a25 admin admin] PATH_INFO: `/v3/projects/200abce4abbe41ad9945f9303cec8910/users/2164949241c74b06a9f1f07ba8de028f/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:39.454181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:39.456491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:39.463629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10325f7d-369f-4fdf-927b-5166414a4a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200abce4abbe41ad9945f9303cec8910, user_id=2164949241c74b06a9f1f07ba8de028f, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:39.466567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10325f7d-369f-4fdf-927b-5166414a4a25 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:39.473407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4ce2-4af4-41f1-bc09-351935f3cbf7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:39.478452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:39.479369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.479906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.480184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] PATH_INFO: `/v3/projects/428887c699b74f02ba8dcdadaae833a7` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:39.481415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=428887c699b74f02ba8dcdadaae833a7)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:39.483411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:39.589205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 927/1812] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:39 2021] PUT /identity/v3/projects/200abce4abbe41ad9945f9303cec8910/users/2164949241c74b06a9f1f07ba8de028f/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:39.594196 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10325f7d-369f-4fdf-927b-5166414a4a25 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:39.661031 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428887c699b74f02ba8dcdadaae833a7', 'request_id': 'req-f34469f9-ce1c-4c69-83b1-6e8da2157be2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:39.689455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10325f7d-369f-4fdf-927b-5166414a4a25 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:39.744751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428887c699b74f02ba8dcdadaae833a7', 'request_id': 'req-f34469f9-ce1c-4c69-83b1-6e8da2157be2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:39.752742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428887c699b74f02ba8dcdadaae833a7', 'request_id': 'req-f34469f9-ce1c-4c69-83b1-6e8da2157be2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:39.788481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] The token cache is being invalidate because project 428887c699b74f02ba8dcdadaae833a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:39.788904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:39.790920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f34469f9-ce1c-4c69-83b1-6e8da2157be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:39.795190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 886/1813] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:39 2021] DELETE /identity/v3/projects/428887c699b74f02ba8dcdadaae833a7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:39.809232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf058b6-8437-49f9-a5b9-979202e5854d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.811892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf058b6-8437-49f9-a5b9-979202e5854d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.812271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf058b6-8437-49f9-a5b9-979202e5854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:39.824854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:39.830809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.830809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.830809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:39.833406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:39.841561 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:39.879942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-bcf058b6-8437-49f9-a5b9-979202e5854d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:39.881847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bcf058b6-8437-49f9-a5b9-979202e5854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:39.882581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 928/1814] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:39.889334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:39.893180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:39.903351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 887/1815] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:39.909632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b2c2-81cc-4316-863e-d0cea88ef630 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.910734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b2c2-81cc-4316-863e-d0cea88ef630 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.911069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b2c2-81cc-4316-863e-d0cea88ef630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:39.925862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18993e5-3a59-4a7d-96ee-043bf3d17ddb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:39.937537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d1127-7c18-4d80-ac3d-f633c486a9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:39.941034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d1127-7c18-4d80-ac3d-f633c486a9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.942258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d1127-7c18-4d80-ac3d-f633c486a9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.942571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d1127-7c18-4d80-ac3d-f633c486a9a4 admin admin] PATH_INFO: `/v3/projects/200abce4abbe41ad9945f9303cec8910/users/2164949241c74b06a9f1f07ba8de028f/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:39.948918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d1127-7c18-4d80-ac3d-f633c486a9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200abce4abbe41ad9945f9303cec8910, user_id=2164949241c74b06a9f1f07ba8de028f, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:39.952726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d1127-7c18-4d80-ac3d-f633c486a9a4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:39.955035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3619b2c2-81cc-4316-863e-d0cea88ef630 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:39.956396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3619b2c2-81cc-4316-863e-d0cea88ef630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:39.975021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 888/1816] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:39.975930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 929/1817] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:39 2021] PUT /identity/v3/projects/200abce4abbe41ad9945f9303cec8910/users/2164949241c74b06a9f1f07ba8de028f/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:39.979871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619b2c2-81cc-4316-863e-d0cea88ef630 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:39.996120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619b2c2-81cc-4316-863e-d0cea88ef630 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:39.996308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b392-8d3d-4510-9cb1-f4edd6ef1600 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:39.996576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b392-8d3d-4510-9cb1-f4edd6ef1600 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:39.996866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b392-8d3d-4510-9cb1-f4edd6ef1600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.025119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-87c2b392-8d3d-4510-9cb1-f4edd6ef1600 None None] MFA Rules not processed for user `2164949241c74b06a9f1f07ba8de028f`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:40.026486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-87c2b392-8d3d-4510-9cb1-f4edd6ef1600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:40.079768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:40.081059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.081443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.081942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.082845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:40.083502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:40.085563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:40.107039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 930/1818] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:39 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:40.113736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2b392-8d3d-4510-9cb1-f4edd6ef1600 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:40.124360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-87c2b392-8d3d-4510-9cb1-f4edd6ef1600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:40.134292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 889/1819] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:40.135497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:40.169973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2ce1-d201-424c-9e26-e9e974fb1d1d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:40.183080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa50f2-9076-43a2-9713-f50b623f3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:40.183765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa50f2-9076-43a2-9713-f50b623f3408 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.184049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa50f2-9076-43a2-9713-f50b623f3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.184331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa50f2-9076-43a2-9713-f50b623f3408 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.188542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa50f2-9076-43a2-9713-f50b623f3408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:40.190734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa50f2-9076-43a2-9713-f50b623f3408 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:40.266233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2b392-8d3d-4510-9cb1-f4edd6ef1600 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:40.273014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31212395-401e-4caa-94f9-014a6f65c799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:40.273014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212395-401e-4caa-94f9-014a6f65c799 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.273265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212395-401e-4caa-94f9-014a6f65c799 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.273383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212395-401e-4caa-94f9-014a6f65c799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.284054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31212395-401e-4caa-94f9-014a6f65c799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:40.284882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31212395-401e-4caa-94f9-014a6f65c799 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:40.296448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 931/1820] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:40 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:40.438158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 890/1821] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:40 2021] POST /identity/v3/projects => generated 385 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:40.441950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31212395-401e-4caa-94f9-014a6f65c799 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:40.470475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31212395-401e-4caa-94f9-014a6f65c799 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:40.476423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa50f2-9076-43a2-9713-f50b623f3408 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:40.635601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa50f2-9076-43a2-9713-f50b623f3408 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:40.640284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:40.641220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.642097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.642990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.643132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a5aee-b4f2-490e-bbac-cd86e999844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:40.644840 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:40.646881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5aee-b4f2-490e-bbac-cd86e999844f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.647257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5aee-b4f2-490e-bbac-cd86e999844f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.647546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a5aee-b4f2-490e-bbac-cd86e999844f admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.648292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a5aee-b4f2-490e-bbac-cd86e999844f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:40.651631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a5aee-b4f2-490e-bbac-cd86e999844f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:40.726141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:40.727720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:40.739818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 891/1822] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:40 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:40.811778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 932/1823] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:40 2021] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:40.818823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:40.830354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441673b2-151e-4a29-b642-f77d91fafd30 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:40.841341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b077c22-273c-40f5-bd66-7e4f3b877935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:40.842314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b077c22-273c-40f5-bd66-7e4f3b877935 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.842850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b077c22-273c-40f5-bd66-7e4f3b877935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.843333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b077c22-273c-40f5-bd66-7e4f3b877935 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.844351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b077c22-273c-40f5-bd66-7e4f3b877935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:40.849543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b077c22-273c-40f5-bd66-7e4f3b877935 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:40.864504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e553c5-fc81-4e88-84be-26a1f6e7e0f0 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.865036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e553c5-fc81-4e88-84be-26a1f6e7e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.876379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e553c5-fc81-4e88-84be-26a1f6e7e0f0 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.876379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 933/1824] 10.222.0.16 () {54 vars in 921 bytes} [Thu Nov 11 17:14:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:14:40.882405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 892/1825] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:40.887553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e553c5-fc81-4e88-84be-26a1f6e7e0f0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:40.918305 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e553c5-fc81-4e88-84be-26a1f6e7e0f0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:40.926956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242bea-55d1-413a-b179-9696a871b28b None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.927373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242bea-55d1-413a-b179-9696a871b28b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.927708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242bea-55d1-413a-b179-9696a871b28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.934498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c90c6-d3c4-4dcb-9125-fc925d2c5bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:40.947992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c90c6-d3c4-4dcb-9125-fc925d2c5bec admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:40.947992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c90c6-d3c4-4dcb-9125-fc925d2c5bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:40.947992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c90c6-d3c4-4dcb-9125-fc925d2c5bec admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:40.947992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c90c6-d3c4-4dcb-9125-fc925d2c5bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:40.951475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c90c6-d3c4-4dcb-9125-fc925d2c5bec admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:40.972375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-bb242bea-55d1-413a-b179-9696a871b28b None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:40.975815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bb242bea-55d1-413a-b179-9696a871b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:40.993216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 934/1826] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:40.994808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c90c6-d3c4-4dcb-9125-fc925d2c5bec admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:41.023595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c90c6-d3c4-4dcb-9125-fc925d2c5bec admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:41.041804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f916-e1cd-4e61-aa27-ec1cc840a058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:41.055820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f916-e1cd-4e61-aa27-ec1cc840a058 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:41.056432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f916-e1cd-4e61-aa27-ec1cc840a058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:41.056941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f916-e1cd-4e61-aa27-ec1cc840a058 admin admin] PATH_INFO: `/v3/projects/f68c977e02ff45ec9758a3f614f48542/users/98625f02de2f4275b652e85a080632f7/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:41.092623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f916-e1cd-4e61-aa27-ec1cc840a058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68c977e02ff45ec9758a3f614f48542, user_id=98625f02de2f4275b652e85a080632f7, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:41.102097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f916-e1cd-4e61-aa27-ec1cc840a058 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:41.161129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 893/1827] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Nov 11 17:14:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:41.197464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb242bea-55d1-413a-b179-9696a871b28b None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:41.199654 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bb242bea-55d1-413a-b179-9696a871b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:41.227911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb242bea-55d1-413a-b179-9696a871b28b None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:41.228008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 935/1828] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:40 2021] PUT /identity/v3/projects/f68c977e02ff45ec9758a3f614f48542/users/98625f02de2f4275b652e85a080632f7/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:41.239237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf76c-cbff-4d87-8532-a49361f9d7df None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:41.240234 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf76c-cbff-4d87-8532-a49361f9d7df None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:41.240688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf76c-cbff-4d87-8532-a49361f9d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:41.322181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0e5bf76c-cbff-4d87-8532-a49361f9d7df None None] MFA Rules not processed for user `98625f02de2f4275b652e85a080632f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:41.323431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0e5bf76c-cbff-4d87-8532-a49361f9d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:41.340945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:41.342573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:41.343432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:41.344430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:41.395132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:41.411358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:41.433483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 894/1829] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:41.441470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:41.443682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:41.459671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 936/1830] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:41 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:41.605078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724847f0-7ec1-4d0d-aeea-0b8e90b709f9 service nova] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:41.617796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:41.618809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:41.619155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:41.619549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] PATH_INFO: `/v3/users/aa4431fec3da4a87877d5d29709e3fb2` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:41.631449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4431fec3da4a87877d5d29709e3fb2)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:41.637819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:41.897627 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4431fec3da4a87877d5d29709e3fb2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:41.900402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4431fec3da4a87877d5d29709e3fb2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:41.901510 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4431fec3da4a87877d5d29709e3fb2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:42.001801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4431fec3da4a87877d5d29709e3fb2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:42.027273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4431fec3da4a87877d5d29709e3fb2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:42.041184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 895/1831] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:41 2021] DELETE /identity/v3/users/aa4431fec3da4a87877d5d29709e3fb2 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:42.046120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c5cc-3e48-42ec-848f-f8357e392ab5 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:42.046655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c5cc-3e48-42ec-848f-f8357e392ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:42.046749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c5cc-3e48-42ec-848f-f8357e392ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:42.065034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7e12c5cc-3e48-42ec-848f-f8357e392ab5 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:42.066221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7e12c5cc-3e48-42ec-848f-f8357e392ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:42.142806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 937/1832] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:42.159930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:42.162125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:42.233609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12c5cc-3e48-42ec-848f-f8357e392ab5 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:42.235438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7e12c5cc-3e48-42ec-848f-f8357e392ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:42.292098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a294b9-fceb-4995-8100-0b96dea90a7f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:42.308493 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:42.310713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:42.311832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:42.312927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:42.341275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:42.353403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:42.359451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12c5cc-3e48-42ec-848f-f8357e392ab5 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:42.369566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4dd09e-6517-49de-a4a6-3b76929f29ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:42.371834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dd09e-6517-49de-a4a6-3b76929f29ca service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:42.372306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dd09e-6517-49de-a4a6-3b76929f29ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:42.372722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4dd09e-6517-49de-a4a6-3b76929f29ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:42.379818 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8a4dd09e-6517-49de-a4a6-3b76929f29ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:42.385609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 896/1833] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:42.504927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dd09e-6517-49de-a4a6-3b76929f29ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:42.507870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4dd09e-6517-49de-a4a6-3b76929f29ca service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:42.530877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 938/1834] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:42 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:42.558976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:42.560407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:42.567910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e3acd-462e-4adc-a74a-7e82999c915b None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:42.568192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e3acd-462e-4adc-a74a-7e82999c915b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:42.568466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e3acd-462e-4adc-a74a-7e82999c915b None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:42.571267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 939/1835] 10.222.0.16 () {54 vars in 921 bytes} [Thu Nov 11 17:14:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 11 17:14:42.586444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e5518-d03c-43f8-9c27-951340ea0fd8 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:42.599040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:42.600010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:42.600485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:42.600765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] PATH_INFO: `/v3/users/98625f02de2f4275b652e85a080632f7` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:42.602173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98625f02de2f4275b652e85a080632f7)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:42.607827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314c63-fb8e-48e7-9d15-deb06a6e2720 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:42.608095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314c63-fb8e-48e7-9d15-deb06a6e2720 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:42.608348 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95314c63-fb8e-48e7-9d15-deb06a6e2720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:42.636635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:42.669360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-95314c63-fb8e-48e7-9d15-deb06a6e2720 None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:42.675369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-95314c63-fb8e-48e7-9d15-deb06a6e2720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:42.841527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 940/1836] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Nov 11 17:14:42 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:42.854893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95314c63-fb8e-48e7-9d15-deb06a6e2720 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:42.855959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-95314c63-fb8e-48e7-9d15-deb06a6e2720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:42.872605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95314c63-fb8e-48e7-9d15-deb06a6e2720 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:42.881198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c329-96d8-4845-839f-95e1a8971119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:42.883734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c329-96d8-4845-839f-95e1a8971119 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:42.883734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c329-96d8-4845-839f-95e1a8971119 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:42.883734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c329-96d8-4845-839f-95e1a8971119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:42.894765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c329-96d8-4845-839f-95e1a8971119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:42.896645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c329-96d8-4845-839f-95e1a8971119 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:42.924866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98625f02de2f4275b652e85a080632f7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:42.926647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98625f02de2f4275b652e85a080632f7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:42.928845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98625f02de2f4275b652e85a080632f7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:42.931960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 941/1837] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:42.934111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c329-96d8-4845-839f-95e1a8971119 service nova] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:42.972431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c329-96d8-4845-839f-95e1a8971119 service nova] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:42.978812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a1ef1-08ec-4b7c-aa9d-ece5e82328a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:42.981192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a1ef1-08ec-4b7c-aa9d-ece5e82328a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:42.981192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a1ef1-08ec-4b7c-aa9d-ece5e82328a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:42.981192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a1ef1-08ec-4b7c-aa9d-ece5e82328a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:42.982662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-897a1ef1-08ec-4b7c-aa9d-ece5e82328a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:43.070845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98625f02de2f4275b652e85a080632f7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:43.088298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a1ef1-08ec-4b7c-aa9d-ece5e82328a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:43.089751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a1ef1-08ec-4b7c-aa9d-ece5e82328a5 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:43.094708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98625f02de2f4275b652e85a080632f7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:43.100542 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 942/1838] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:42 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:43.116199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 897/1839] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:42 2021] DELETE /identity/v3/users/98625f02de2f4275b652e85a080632f7 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:43.118317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94c3f-1a38-4c28-847c-4d4de20fdad3 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:43.119762 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94c3f-1a38-4c28-847c-4d4de20fdad3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:43.120254 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94c3f-1a38-4c28-847c-4d4de20fdad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:43.181805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-1ae94c3f-1a38-4c28-847c-4d4de20fdad3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:43.184264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1ae94c3f-1a38-4c28-847c-4d4de20fdad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:43.301065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 943/1840] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:43.312268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:43.313903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:43.382800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7f0cb-6e19-4902-8d29-05c0dd0c5c4b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:43.387305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ed84b-05ae-4194-ab90-580bce3899ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:43.387952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ed84b-05ae-4194-ab90-580bce3899ab service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:43.388239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ed84b-05ae-4194-ab90-580bce3899ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:43.388566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ed84b-05ae-4194-ab90-580bce3899ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:43.399114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ed84b-05ae-4194-ab90-580bce3899ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:43.400663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ed84b-05ae-4194-ab90-580bce3899ab service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:43.412772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 898/1841] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:43.584024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae94c3f-1a38-4c28-847c-4d4de20fdad3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:43.586447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1ae94c3f-1a38-4c28-847c-4d4de20fdad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:43.608288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae94c3f-1a38-4c28-847c-4d4de20fdad3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:43.618402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:43.620476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:43.620954 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:43.621432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] PATH_INFO: `/v3/projects/8b7dc78018744605a3377c1cc03a48d8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:43.623775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7dc78018744605a3377c1cc03a48d8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:43.628151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:43.771866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7dc78018744605a3377c1cc03a48d8', 'request_id': 'req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:44.326891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7dc78018744605a3377c1cc03a48d8', 'request_id': 'req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:44.340025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7dc78018744605a3377c1cc03a48d8', 'request_id': 'req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:44.349279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] The token cache is being invalidate because project 8b7dc78018744605a3377c1cc03a48d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:44.349794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:44.350772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:44.355333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 944/1842] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:43 2021] DELETE /identity/v3/projects/8b7dc78018744605a3377c1cc03a48d8 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:44.359996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ed84b-05ae-4194-ab90-580bce3899ab service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:44.371446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ed84b-05ae-4194-ab90-580bce3899ab service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:44.440829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:44.442108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:44.442401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:44.442741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] PATH_INFO: `/v3/users/4cb5a5e2bbc542bc824f63470fbda58c` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:44.444181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb5a5e2bbc542bc824f63470fbda58c)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:44.446292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:44.813384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:44.815094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:44.839520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956dbca-ea3d-4ea1-bc71-3bbb7a981215 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:44.853369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:44.854192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:44.854766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:44.855058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] PATH_INFO: `/v3/projects/f68c977e02ff45ec9758a3f614f48542` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:44.856273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68c977e02ff45ec9758a3f614f48542)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:44.858432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:45.018224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb5a5e2bbc542bc824f63470fbda58c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.018981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb5a5e2bbc542bc824f63470fbda58c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.019656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb5a5e2bbc542bc824f63470fbda58c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.045768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68c977e02ff45ec9758a3f614f48542', 'request_id': 'req-a0753c89-a65e-4c3d-80df-4fe7fb165054'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.140753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb5a5e2bbc542bc824f63470fbda58c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.163091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a705f740-0583-4aa6-b9da-40e835169269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb5a5e2bbc542bc824f63470fbda58c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.175853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 899/1843] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:44 2021] DELETE /identity/v3/users/4cb5a5e2bbc542bc824f63470fbda58c => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:45.241644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68c977e02ff45ec9758a3f614f48542', 'request_id': 'req-a0753c89-a65e-4c3d-80df-4fe7fb165054'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.248264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68c977e02ff45ec9758a3f614f48542', 'request_id': 'req-a0753c89-a65e-4c3d-80df-4fe7fb165054'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.260256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] The token cache is being invalidate because project f68c977e02ff45ec9758a3f614f48542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:45.260537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.261171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a0753c89-a65e-4c3d-80df-4fe7fb165054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.262748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 945/1844] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:44 2021] DELETE /identity/v3/projects/f68c977e02ff45ec9758a3f614f48542 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:45.268790 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d679-69a2-48cf-84ba-5a4df124c524 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.269226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d679-69a2-48cf-84ba-5a4df124c524 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.269512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d679-69a2-48cf-84ba-5a4df124c524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.286820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-2fd7d679-69a2-48cf-84ba-5a4df124c524 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:45.288040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2fd7d679-69a2-48cf-84ba-5a4df124c524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:45.346710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 900/1845] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:45.354078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cf79-1916-439d-bcfa-dc19d5b52fdc None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.354856 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cf79-1916-439d-bcfa-dc19d5b52fdc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.355158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926cf79-1916-439d-bcfa-dc19d5b52fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.376025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3926cf79-1916-439d-bcfa-dc19d5b52fdc None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:45.377266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3926cf79-1916-439d-bcfa-dc19d5b52fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:45.385095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 946/1846] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:45.389381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7d679-69a2-48cf-84ba-5a4df124c524 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:45.399019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7d679-69a2-48cf-84ba-5a4df124c524 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:45.403898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:45.404577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.404859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.405407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.406119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:45.406421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:45.408159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:45.420275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 901/1847] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:45.424944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926cf79-1916-439d-bcfa-dc19d5b52fdc None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:45.435463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926cf79-1916-439d-bcfa-dc19d5b52fdc None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:45.440408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:45.441064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.441341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.441618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.442335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:45.444272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:45.556567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 947/1848] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:45 2021] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:45.560615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:45.570721 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecc419-3f69-4286-8a11-77f7201f9fff admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:45.634893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bf519-58eb-4391-9575-89c6b238a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:45.635691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf519-58eb-4391-9575-89c6b238a5ee admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.635999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf519-58eb-4391-9575-89c6b238a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.636444 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bf519-58eb-4391-9575-89c6b238a5ee admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.637175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bf519-58eb-4391-9575-89c6b238a5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:45.639289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bf519-58eb-4391-9575-89c6b238a5ee admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:45.743228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:45.743406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 902/1849] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:45 2021] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:45.743516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:45.744788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bf519-58eb-4391-9575-89c6b238a5ee admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:45.756939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bf519-58eb-4391-9575-89c6b238a5ee admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:45.758901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbb2bf-4dd0-48d4-a157-a7ca9a13144e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:45.762038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe754210-bafa-4f3a-bd93-a9cba9830ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:45.762882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe754210-bafa-4f3a-bd93-a9cba9830ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.763319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe754210-bafa-4f3a-bd93-a9cba9830ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.763549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe754210-bafa-4f3a-bd93-a9cba9830ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.764354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:45.764807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe754210-bafa-4f3a-bd93-a9cba9830ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:45.765223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.765503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.765774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] PATH_INFO: `/v3/projects/de64d1633f8c4ad39cf1bcc34734a546` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.766878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe754210-bafa-4f3a-bd93-a9cba9830ba2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:45.767218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de64d1633f8c4ad39cf1bcc34734a546)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:45.769056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:45.778350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 903/1850] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:45.782464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe754210-bafa-4f3a-bd93-a9cba9830ba2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:45.793184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe754210-bafa-4f3a-bd93-a9cba9830ba2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:45.798331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500dcd-e91d-4357-a7b9-9723f2f38877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:45.799233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500dcd-e91d-4357-a7b9-9723f2f38877 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.799684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500dcd-e91d-4357-a7b9-9723f2f38877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.800144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500dcd-e91d-4357-a7b9-9723f2f38877 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.800766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500dcd-e91d-4357-a7b9-9723f2f38877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:45.802357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500dcd-e91d-4357-a7b9-9723f2f38877 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:45.812972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 904/1851] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:45.816972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500dcd-e91d-4357-a7b9-9723f2f38877 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:45.826604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500dcd-e91d-4357-a7b9-9723f2f38877 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:45.832247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac048a-31a9-4f3f-bf89-0ac86dfeb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:45.833099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac048a-31a9-4f3f-bf89-0ac86dfeb449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.833378 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac048a-31a9-4f3f-bf89-0ac86dfeb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.833648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac048a-31a9-4f3f-bf89-0ac86dfeb449 admin admin] PATH_INFO: `/v3/projects/c6d8fc3dee5747d7904bc78b9b0b23de/users/948a63929f124b5887cc21f8dbf14987/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.848052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac048a-31a9-4f3f-bf89-0ac86dfeb449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d8fc3dee5747d7904bc78b9b0b23de, user_id=948a63929f124b5887cc21f8dbf14987, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:45.850802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac048a-31a9-4f3f-bf89-0ac86dfeb449 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:45.951188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 905/1852] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:45 2021] PUT /identity/v3/projects/c6d8fc3dee5747d7904bc78b9b0b23de/users/948a63929f124b5887cc21f8dbf14987/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:45.959078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de64d1633f8c4ad39cf1bcc34734a546', 'request_id': 'req-b259717a-2535-40a8-9542-ca691d75bc2e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:45.964810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76a6b-4ac5-4c67-81c6-1ed5fd476c37 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:45.964810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76a6b-4ac5-4c67-81c6-1ed5fd476c37 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:45.964810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c76a6b-4ac5-4c67-81c6-1ed5fd476c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:45.988544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c1c76a6b-4ac5-4c67-81c6-1ed5fd476c37 None None] MFA Rules not processed for user `948a63929f124b5887cc21f8dbf14987`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:45.989298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c1c76a6b-4ac5-4c67-81c6-1ed5fd476c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.049500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 906/1853] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:45 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:46.064615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de64d1633f8c4ad39cf1bcc34734a546', 'request_id': 'req-b259717a-2535-40a8-9542-ca691d75bc2e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.071906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de64d1633f8c4ad39cf1bcc34734a546', 'request_id': 'req-b259717a-2535-40a8-9542-ca691d75bc2e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.079389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c76a6b-4ac5-4c67-81c6-1ed5fd476c37 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.080946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c1c76a6b-4ac5-4c67-81c6-1ed5fd476c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.085579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] The token cache is being invalidate because project de64d1633f8c4ad39cf1bcc34734a546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:46.085939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.087263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-b259717a-2535-40a8-9542-ca691d75bc2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.088895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 948/1854] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:45 2021] DELETE /identity/v3/projects/de64d1633f8c4ad39cf1bcc34734a546 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:46.094867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475940a9-ca62-4a84-a840-415036d8bb8e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.095156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475940a9-ca62-4a84-a840-415036d8bb8e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.095440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475940a9-ca62-4a84-a840-415036d8bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.119449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-475940a9-ca62-4a84-a840-415036d8bb8e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:46.120660 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-475940a9-ca62-4a84-a840-415036d8bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.143239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c76a6b-4ac5-4c67-81c6-1ed5fd476c37 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.146754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9133b6-54d0-43c0-a470-0b10d1418431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.147393 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9133b6-54d0-43c0-a470-0b10d1418431 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.147665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9133b6-54d0-43c0-a470-0b10d1418431 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.147931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9133b6-54d0-43c0-a470-0b10d1418431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.150238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-dd9133b6-54d0-43c0-a470-0b10d1418431 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.168660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9133b6-54d0-43c0-a470-0b10d1418431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.170407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9133b6-54d0-43c0-a470-0b10d1418431 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.180467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 907/1855] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:46 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:46.183822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 949/1856] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:46.193262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f91b0-baa7-4bdb-ba8b-312cf3ca0ff7 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.193459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f91b0-baa7-4bdb-ba8b-312cf3ca0ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.193740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f91b0-baa7-4bdb-ba8b-312cf3ca0ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.196248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475940a9-ca62-4a84-a840-415036d8bb8e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.197866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-475940a9-ca62-4a84-a840-415036d8bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.209168 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475940a9-ca62-4a84-a840-415036d8bb8e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.212443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-771f91b0-baa7-4bdb-ba8b-312cf3ca0ff7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:46.213752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-771f91b0-baa7-4bdb-ba8b-312cf3ca0ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.215840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.216794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.217144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.217493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] PATH_INFO: `/v3/users/948a63929f124b5887cc21f8dbf14987` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.218932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948a63929f124b5887cc21f8dbf14987)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.221055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.221708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 908/1857] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:46.225776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f91b0-baa7-4bdb-ba8b-312cf3ca0ff7 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.234889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f91b0-baa7-4bdb-ba8b-312cf3ca0ff7 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.239756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.240512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.240695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.240965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.241696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:46.241998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.244160 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.258599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 909/1858] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:14:46.263109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.272882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ac661-78d9-455d-aa57-60c79d959477 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.278661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa7bf9-6652-444e-8eee-fb9be79fdc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.279313 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa7bf9-6652-444e-8eee-fb9be79fdc3f admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.279589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa7bf9-6652-444e-8eee-fb9be79fdc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.279863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa7bf9-6652-444e-8eee-fb9be79fdc3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.280718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa7bf9-6652-444e-8eee-fb9be79fdc3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.282778 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa7bf9-6652-444e-8eee-fb9be79fdc3f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.443736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 910/1859] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:46 2021] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:46.447754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa7bf9-6652-444e-8eee-fb9be79fdc3f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.484741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948a63929f124b5887cc21f8dbf14987'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.485663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948a63929f124b5887cc21f8dbf14987'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.486430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948a63929f124b5887cc21f8dbf14987'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.506274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa7bf9-6652-444e-8eee-fb9be79fdc3f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.511142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.511809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.512087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.512386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.513104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.515244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.573010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948a63929f124b5887cc21f8dbf14987'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.585800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1d6b5dc9-466b-43de-9667-3f98a7f85be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948a63929f124b5887cc21f8dbf14987'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:46.598689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 950/1860] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:46 2021] DELETE /identity/v3/users/948a63929f124b5887cc21f8dbf14987 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:46.603893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cb754-3bad-4558-bcc2-5253b6a9f856 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.604183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cb754-3bad-4558-bcc2-5253b6a9f856 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.604721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cb754-3bad-4558-bcc2-5253b6a9f856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.622042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-122cb754-3bad-4558-bcc2-5253b6a9f856 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:46.623300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-122cb754-3bad-4558-bcc2-5253b6a9f856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.631183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 911/1861] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:46 2021] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:46.639232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.641401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.657156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39609b-c225-4002-a65d-01635e3be6cb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.690308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 951/1862] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:46.700689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cb754-3bad-4558-bcc2-5253b6a9f856 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.702701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-122cb754-3bad-4558-bcc2-5253b6a9f856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:46.717264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce7056-37f6-4269-a517-064ee2392781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.717941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce7056-37f6-4269-a517-064ee2392781 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.722161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce7056-37f6-4269-a517-064ee2392781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.722161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce7056-37f6-4269-a517-064ee2392781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.722161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce7056-37f6-4269-a517-064ee2392781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.722161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce7056-37f6-4269-a517-064ee2392781 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.743535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 912/1863] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:46.744590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce7056-37f6-4269-a517-064ee2392781 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.761513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce7056-37f6-4269-a517-064ee2392781 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.775661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08068c4-ce40-454b-93e3-6716fe38ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.776499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08068c4-ce40-454b-93e3-6716fe38ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.776785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08068c4-ce40-454b-93e3-6716fe38ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.777058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08068c4-ce40-454b-93e3-6716fe38ee08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.777796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08068c4-ce40-454b-93e3-6716fe38ee08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.780116 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08068c4-ce40-454b-93e3-6716fe38ee08 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.783185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cb754-3bad-4558-bcc2-5253b6a9f856 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.787253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346000c4-b846-4fb2-836b-43730575e2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.787903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346000c4-b846-4fb2-836b-43730575e2ee service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.788183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346000c4-b846-4fb2-836b-43730575e2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.788453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346000c4-b846-4fb2-836b-43730575e2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.792933 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 913/1864] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:46.800372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346000c4-b846-4fb2-836b-43730575e2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.800696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08068c4-ce40-454b-93e3-6716fe38ee08 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:46.801938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346000c4-b846-4fb2-836b-43730575e2ee service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.812626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08068c4-ce40-454b-93e3-6716fe38ee08 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:46.813999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 952/1865] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:46.817649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137356dd-7f7f-4dea-8d09-47b5ea9b4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:46.818655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137356dd-7f7f-4dea-8d09-47b5ea9b4cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.819354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137356dd-7f7f-4dea-8d09-47b5ea9b4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.819354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137356dd-7f7f-4dea-8d09-47b5ea9b4cc0 admin admin] PATH_INFO: `/v3/projects/fd20499e38dc45c098708d04d4f8d6b2/users/7e0ad66175c148a4abadf7d97028b0a1/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.837707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137356dd-7f7f-4dea-8d09-47b5ea9b4cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd20499e38dc45c098708d04d4f8d6b2, user_id=7e0ad66175c148a4abadf7d97028b0a1, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:46.837707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137356dd-7f7f-4dea-8d09-47b5ea9b4cc0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:46.943596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 914/1866] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:46 2021] PUT /identity/v3/projects/fd20499e38dc45c098708d04d4f8d6b2/users/7e0ad66175c148a4abadf7d97028b0a1/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:46.955004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028615fd-0415-4461-86c4-ecf345ebda4d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:46.955515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028615fd-0415-4461-86c4-ecf345ebda4d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:46.955786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028615fd-0415-4461-86c4-ecf345ebda4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:46.996513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-028615fd-0415-4461-86c4-ecf345ebda4d None None] MFA Rules not processed for user `7e0ad66175c148a4abadf7d97028b0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:46.999173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-028615fd-0415-4461-86c4-ecf345ebda4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:47.089910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 953/1867] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:46 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:47.095139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137356dd-7f7f-4dea-8d09-47b5ea9b4cc0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:47.186323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137356dd-7f7f-4dea-8d09-47b5ea9b4cc0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:47.191794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:47.192580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:47.198521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:47.198521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:47.198521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:47.198521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:47.395931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 915/1868] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:47 2021] POST /identity/v3/projects => generated 387 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:47.400891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028615fd-0415-4461-86c4-ecf345ebda4d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:47.420604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028615fd-0415-4461-86c4-ecf345ebda4d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:47.487245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbee650-fc47-4700-8698-d9716e24ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:47.487245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee650-fc47-4700-8698-d9716e24ce1c admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:47.487245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee650-fc47-4700-8698-d9716e24ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:47.487245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbee650-fc47-4700-8698-d9716e24ce1c admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:47.488121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbee650-fc47-4700-8698-d9716e24ce1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:47.488121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbee650-fc47-4700-8698-d9716e24ce1c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:47.598857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:47.600798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:47.613183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2dfc7-1058-4672-84ad-93ad70b46032 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:47.618758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:47.620329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:47.620531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:47.620832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] PATH_INFO: `/v3/projects/c6d8fc3dee5747d7904bc78b9b0b23de` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:47.622040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d8fc3dee5747d7904bc78b9b0b23de)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:47.624058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:47.687770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 954/1869] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:47 2021] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:47.693375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbee650-fc47-4700-8698-d9716e24ce1c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:47.712572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbee650-fc47-4700-8698-d9716e24ce1c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:47.712572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438f40-c43b-4b42-bfcc-659c71acacf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:47.712572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438f40-c43b-4b42-bfcc-659c71acacf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:47.712572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438f40-c43b-4b42-bfcc-659c71acacf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:47.712899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49438f40-c43b-4b42-bfcc-659c71acacf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:47.712899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49438f40-c43b-4b42-bfcc-659c71acacf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:47.712899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49438f40-c43b-4b42-bfcc-659c71acacf2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:47.723352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 955/1870] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:47.727595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438f40-c43b-4b42-bfcc-659c71acacf2 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:47.738229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49438f40-c43b-4b42-bfcc-659c71acacf2 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:47.753059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d8fc3dee5747d7904bc78b9b0b23de', 'request_id': 'req-07488c24-23a9-4e3b-90e2-72898898ab9d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:47.795604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:47.796499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:47.796776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:47.797049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] PATH_INFO: `/v3/projects/c236277d76dc48d5856d5316bbc30ca9/users/242d6c92eeff42ca8b93522ce4416c63/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:47.812288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c236277d76dc48d5856d5316bbc30ca9, user_id=242d6c92eeff42ca8b93522ce4416c63, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:47.815903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:47.841631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d8fc3dee5747d7904bc78b9b0b23de', 'request_id': 'req-07488c24-23a9-4e3b-90e2-72898898ab9d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:47.848337 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d8fc3dee5747d7904bc78b9b0b23de', 'request_id': 'req-07488c24-23a9-4e3b-90e2-72898898ab9d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:47.859940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] The token cache is being invalidate because project c6d8fc3dee5747d7904bc78b9b0b23de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:47.860311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:47.861023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-07488c24-23a9-4e3b-90e2-72898898ab9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:47.862752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 916/1871] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:47 2021] DELETE /identity/v3/projects/c6d8fc3dee5747d7904bc78b9b0b23de => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:47.871835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c02a-b31d-4007-b490-ac8317bc531f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:47.872275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c02a-b31d-4007-b490-ac8317bc531f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:47.872593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56c02a-b31d-4007-b490-ac8317bc531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:47.894693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6d56c02a-b31d-4007-b490-ac8317bc531f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:47.895979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6d56c02a-b31d-4007-b490-ac8317bc531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:47.909438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 917/1872] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:47.913928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32838e9-a1df-4cf7-b78c-5d43bc552939 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:47.914210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32838e9-a1df-4cf7-b78c-5d43bc552939 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:47.914484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32838e9-a1df-4cf7-b78c-5d43bc552939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:47.932943 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e32838e9-a1df-4cf7-b78c-5d43bc552939 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:47.934124 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e32838e9-a1df-4cf7-b78c-5d43bc552939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:47.946497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 956/1873] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:47 2021] PUT /identity/v3/projects/c236277d76dc48d5856d5316bbc30ca9/users/242d6c92eeff42ca8b93522ce4416c63/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:47.954333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:47.956395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:48.018590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 918/1874] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:48.020148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32838e9-a1df-4cf7-b78c-5d43bc552939 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.032438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32838e9-a1df-4cf7-b78c-5d43bc552939 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.038182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b59b8-cde2-4661-ab68-6cadbfed5417 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.038354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.039113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.039672 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.039948 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.040807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:48.041115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.042754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.049148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08b524-20ad-4f7c-8407-7f4ca103b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.049826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b524-20ad-4f7c-8407-7f4ca103b6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.050104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b524-20ad-4f7c-8407-7f4ca103b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.050378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b524-20ad-4f7c-8407-7f4ca103b6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.051752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08b524-20ad-4f7c-8407-7f4ca103b6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.054373 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08b524-20ad-4f7c-8407-7f4ca103b6e7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.056813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 919/1875] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:14:48.061050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.073965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 957/1876] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:47 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:48.074958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08b524-20ad-4f7c-8407-7f4ca103b6e7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.084082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d673911-ee99-4f2e-a2be-e955b962059d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.085252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08b524-20ad-4f7c-8407-7f4ca103b6e7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.089299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5ad5-78f5-4c89-ace2-119a9a624ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.089966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5ad5-78f5-4c89-ace2-119a9a624ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.090266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5ad5-78f5-4c89-ace2-119a9a624ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.090527 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5ad5-78f5-4c89-ace2-119a9a624ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.091339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f5ad5-78f5-4c89-ace2-119a9a624ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.091453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0d07d-0b08-442c-9f32-5f72ea060a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.092388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d07d-0b08-442c-9f32-5f72ea060a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.092734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d07d-0b08-442c-9f32-5f72ea060a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.093070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0d07d-0b08-442c-9f32-5f72ea060a5b admin admin] PATH_INFO: `/v3/projects/c236277d76dc48d5856d5316bbc30ca9/users/242d6c92eeff42ca8b93522ce4416c63/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.093558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f5ad5-78f5-4c89-ace2-119a9a624ec5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.095236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d07d-0b08-442c-9f32-5f72ea060a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c236277d76dc48d5856d5316bbc30ca9, user_id=242d6c92eeff42ca8b93522ce4416c63, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.098286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0d07d-0b08-442c-9f32-5f72ea060a5b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.118639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 958/1877] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:48 2021] PUT /identity/v3/projects/c236277d76dc48d5856d5316bbc30ca9/users/242d6c92eeff42ca8b93522ce4416c63/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:48.121256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5a4c-9a7f-44a9-b099-4a957b441737 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.121548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5a4c-9a7f-44a9-b099-4a957b441737 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.121820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5a4c-9a7f-44a9-b099-4a957b441737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.149139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-634d5a4c-9a7f-44a9-b099-4a957b441737 None None] MFA Rules not processed for user `242d6c92eeff42ca8b93522ce4416c63`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:48.150589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-634d5a4c-9a7f-44a9-b099-4a957b441737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:48.213847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 920/1878] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:48 2021] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:48.215280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5ad5-78f5-4c89-ace2-119a9a624ec5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.221443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 959/1879] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:48 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:48.283764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5ad5-78f5-4c89-ace2-119a9a624ec5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.288431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f2075-4065-4b79-9a16-b0bc58be5a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.289128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2075-4065-4b79-9a16-b0bc58be5a52 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.289414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2075-4065-4b79-9a16-b0bc58be5a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.289689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2075-4065-4b79-9a16-b0bc58be5a52 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.290465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f2075-4065-4b79-9a16-b0bc58be5a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.292389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f2075-4065-4b79-9a16-b0bc58be5a52 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.407577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d5a4c-9a7f-44a9-b099-4a957b441737 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.408988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-634d5a4c-9a7f-44a9-b099-4a957b441737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:48.463071 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 921/1880] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:48 2021] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:48.464210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f2075-4065-4b79-9a16-b0bc58be5a52 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.466179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d5a4c-9a7f-44a9-b099-4a957b441737 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.474162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f2075-4065-4b79-9a16-b0bc58be5a52 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.480773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327161fb-fd2e-4d50-bb0c-78f5d71fc5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.481425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327161fb-fd2e-4d50-bb0c-78f5d71fc5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.481699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327161fb-fd2e-4d50-bb0c-78f5d71fc5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.481992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327161fb-fd2e-4d50-bb0c-78f5d71fc5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.482750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327161fb-fd2e-4d50-bb0c-78f5d71fc5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.484324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327161fb-fd2e-4d50-bb0c-78f5d71fc5f7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.494660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 922/1881] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:48.498872 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327161fb-fd2e-4d50-bb0c-78f5d71fc5f7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.509406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327161fb-fd2e-4d50-bb0c-78f5d71fc5f7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.514275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42095d-c29a-4ba2-8c40-5f6b9e6a2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.514975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42095d-c29a-4ba2-8c40-5f6b9e6a2c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.515254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42095d-c29a-4ba2-8c40-5f6b9e6a2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.515550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42095d-c29a-4ba2-8c40-5f6b9e6a2c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.516274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42095d-c29a-4ba2-8c40-5f6b9e6a2c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.517862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42095d-c29a-4ba2-8c40-5f6b9e6a2c69 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.523966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa067e1f-b8f1-4d35-a31b-c825226202d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.525446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067e1f-b8f1-4d35-a31b-c825226202d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.525942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067e1f-b8f1-4d35-a31b-c825226202d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.526413 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067e1f-b8f1-4d35-a31b-c825226202d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.530844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 923/1882] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:48.532270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42095d-c29a-4ba2-8c40-5f6b9e6a2c69 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.541739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42095d-c29a-4ba2-8c40-5f6b9e6a2c69 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.546410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1b7e9-a52e-4ef4-8ecd-5651a21514c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.547312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b7e9-a52e-4ef4-8ecd-5651a21514c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.547696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b7e9-a52e-4ef4-8ecd-5651a21514c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.547914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1b7e9-a52e-4ef4-8ecd-5651a21514c3 admin admin] PATH_INFO: `/v3/projects/aa634cc6477c4e9487991d2dd18155aa/users/f3f669a191d5407db24f3f5ff6322fcc/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.562495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1b7e9-a52e-4ef4-8ecd-5651a21514c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa634cc6477c4e9487991d2dd18155aa, user_id=f3f669a191d5407db24f3f5ff6322fcc, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.565168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1b7e9-a52e-4ef4-8ecd-5651a21514c3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.590833 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa067e1f-b8f1-4d35-a31b-c825226202d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.592511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa067e1f-b8f1-4d35-a31b-c825226202d9 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.605616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 960/1883] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:48 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:48.638328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa067e1f-b8f1-4d35-a31b-c825226202d9 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.651529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa067e1f-b8f1-4d35-a31b-c825226202d9 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.656953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.657885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.658364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.658672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] PATH_INFO: `/v3/users/7e0ad66175c148a4abadf7d97028b0a1` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.659974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0ad66175c148a4abadf7d97028b0a1)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.662076 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.678594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 924/1884] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:48 2021] PUT /identity/v3/projects/aa634cc6477c4e9487991d2dd18155aa/users/f3f669a191d5407db24f3f5ff6322fcc/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:48.683972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e2ac-1093-4f10-a778-69d204cd2976 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.684289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e2ac-1093-4f10-a778-69d204cd2976 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.684561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e2ac-1093-4f10-a778-69d204cd2976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.713428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-fd39e2ac-1093-4f10-a778-69d204cd2976 None None] MFA Rules not processed for user `f3f669a191d5407db24f3f5ff6322fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:48.718857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fd39e2ac-1093-4f10-a778-69d204cd2976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:48.791313 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 925/1885] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:48 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:48.802728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39e2ac-1093-4f10-a778-69d204cd2976 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:48.804150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fd39e2ac-1093-4f10-a778-69d204cd2976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:48.863699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39e2ac-1093-4f10-a778-69d204cd2976 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:48.870181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb31f5d-8961-4397-bd0a-0f6d8f91ad19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a061423c1f646b8892d646979f84f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:48.871112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31f5d-8961-4397-bd0a-0f6d8f91ad19 service glance] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:48.871656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31f5d-8961-4397-bd0a-0f6d8f91ad19 service glance] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:48.872093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31f5d-8961-4397-bd0a-0f6d8f91ad19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:48.877759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0ad66175c148a4abadf7d97028b0a1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:48.878751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0ad66175c148a4abadf7d97028b0a1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:48.880631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0ad66175c148a4abadf7d97028b0a1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:48.881954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb31f5d-8961-4397-bd0a-0f6d8f91ad19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:48.884056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb31f5d-8961-4397-bd0a-0f6d8f91ad19 service glance] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:48.893397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 926/1886] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:48 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:49.064914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0ad66175c148a4abadf7d97028b0a1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:49.084405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0ad66175c148a4abadf7d97028b0a1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:49.103841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 961/1887] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:48 2021] DELETE /identity/v3/users/7e0ad66175c148a4abadf7d97028b0a1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:49.106173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b9299-c73d-4098-8a7d-fa59b6e67e2e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:49.107162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b9299-c73d-4098-8a7d-fa59b6e67e2e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:49.107453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b9299-c73d-4098-8a7d-fa59b6e67e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:49.138213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3c9b9299-c73d-4098-8a7d-fa59b6e67e2e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:49.139553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3c9b9299-c73d-4098-8a7d-fa59b6e67e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:49.289384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 927/1888] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:49.297120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:49.299525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:49.385091 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1179-0332-4599-b64d-eab1f3469e6c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:49.388941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd408ac7-6d20-4a2a-ab4a-2b051569338e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:49.392904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd408ac7-6d20-4a2a-ab4a-2b051569338e service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:49.392904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd408ac7-6d20-4a2a-ab4a-2b051569338e service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:49.392904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd408ac7-6d20-4a2a-ab4a-2b051569338e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:49.407283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd408ac7-6d20-4a2a-ab4a-2b051569338e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:49.410314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd408ac7-6d20-4a2a-ab4a-2b051569338e service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:49.423131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 962/1889] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:49.934710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b9299-c73d-4098-8a7d-fa59b6e67e2e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:49.934710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3c9b9299-c73d-4098-8a7d-fa59b6e67e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:49.952634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b9299-c73d-4098-8a7d-fa59b6e67e2e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:49.963762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:49.964649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:49.964929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:49.965203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] PATH_INFO: `/v3/projects/fd20499e38dc45c098708d04d4f8d6b2` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:49.966455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd20499e38dc45c098708d04d4f8d6b2)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:49.968389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:50.175255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd20499e38dc45c098708d04d4f8d6b2', 'request_id': 'req-2b23edc8-0110-4834-8184-7668dd6860d9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.270498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd20499e38dc45c098708d04d4f8d6b2', 'request_id': 'req-2b23edc8-0110-4834-8184-7668dd6860d9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.278245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd20499e38dc45c098708d04d4f8d6b2', 'request_id': 'req-2b23edc8-0110-4834-8184-7668dd6860d9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.290267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] The token cache is being invalidate because project fd20499e38dc45c098708d04d4f8d6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:50.290484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.291196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.292792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 928/1890] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:49 2021] DELETE /identity/v3/projects/fd20499e38dc45c098708d04d4f8d6b2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:50.296836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd408ac7-6d20-4a2a-ab4a-2b051569338e service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:50.308683 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd408ac7-6d20-4a2a-ab4a-2b051569338e service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:50.363799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:50.364697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:50.364970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:50.365241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] PATH_INFO: `/v3/users/242d6c92eeff42ca8b93522ce4416c63` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:50.366409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] RBAC: Authorizing `identity:delete_user(user_id=242d6c92eeff42ca8b93522ce4416c63)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:50.368367 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:50.730316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242d6c92eeff42ca8b93522ce4416c63'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.731005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242d6c92eeff42ca8b93522ce4416c63'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.731638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242d6c92eeff42ca8b93522ce4416c63'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.864487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242d6c92eeff42ca8b93522ce4416c63'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.877116 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2cbd6034-a159-4df1-93f4-dcc8d64d954e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242d6c92eeff42ca8b93522ce4416c63'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:50.890631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 963/1891] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:50 2021] DELETE /identity/v3/users/242d6c92eeff42ca8b93522ce4416c63 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:51.353006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:51.357071 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:51.370417 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23edc8-0110-4834-8184-7668dd6860d9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:51.431211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:51.432067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:51.432345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:51.432621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] PATH_INFO: `/v3/projects/c236277d76dc48d5856d5316bbc30ca9` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:51.433812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c236277d76dc48d5856d5316bbc30ca9)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:51.435742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:51.555894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c236277d76dc48d5856d5316bbc30ca9', 'request_id': 'req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:51.652976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c236277d76dc48d5856d5316bbc30ca9', 'request_id': 'req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:51.658980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c236277d76dc48d5856d5316bbc30ca9', 'request_id': 'req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:51.671138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] The token cache is being invalidate because project c236277d76dc48d5856d5316bbc30ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:51.671423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:51.672076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c6b3dcc5-c2bf-47f8-81c4-c5dc43ad9391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:51.673609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 929/1892] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:51 2021] DELETE /identity/v3/projects/c236277d76dc48d5856d5316bbc30ca9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:51.679482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53996c4-4f80-4b5b-8c0b-ef9ab61e5686 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:51.680123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53996c4-4f80-4b5b-8c0b-ef9ab61e5686 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:51.680123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53996c4-4f80-4b5b-8c0b-ef9ab61e5686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:51.698070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-d53996c4-4f80-4b5b-8c0b-ef9ab61e5686 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:51.699328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d53996c4-4f80-4b5b-8c0b-ef9ab61e5686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:51.759957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 964/1893] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:51.768152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7977b54-c721-41b9-9593-fbc3c8c02329 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:51.768521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7977b54-c721-41b9-9593-fbc3c8c02329 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:51.768865 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7977b54-c721-41b9-9593-fbc3c8c02329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:51.788288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a7977b54-c721-41b9-9593-fbc3c8c02329 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:51.790152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a7977b54-c721-41b9-9593-fbc3c8c02329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:51.798042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 930/1894] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:51.802354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53996c4-4f80-4b5b-8c0b-ef9ab61e5686 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:51.812498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53996c4-4f80-4b5b-8c0b-ef9ab61e5686 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:51.817187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:51.817781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:51.818058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:51.818329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:51.819738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:51.820065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:51.821809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:51.833683 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 965/1895] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:14:51.838647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7977b54-c721-41b9-9593-fbc3c8c02329 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:51.848003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7977b54-c721-41b9-9593-fbc3c8c02329 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:51.853090 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e592a38-3545-466a-a779-a349f4b54f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:51.853777 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e592a38-3545-466a-a779-a349f4b54f6c admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:51.854015 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e592a38-3545-466a-a779-a349f4b54f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:51.854313 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e592a38-3545-466a-a779-a349f4b54f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:51.855333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e592a38-3545-466a-a779-a349f4b54f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:51.857253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e592a38-3545-466a-a779-a349f4b54f6c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:51.949755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 931/1896] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:51 2021] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:51.951054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:51.962182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb5edf-896e-4317-ba1d-121378b1070f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:52.020599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e429c-74c5-4cee-85ec-9fc08b86bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:52.021288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e429c-74c5-4cee-85ec-9fc08b86bc18 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.021571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e429c-74c5-4cee-85ec-9fc08b86bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.021845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e429c-74c5-4cee-85ec-9fc08b86bc18 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.022569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e429c-74c5-4cee-85ec-9fc08b86bc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:52.025191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e429c-74c5-4cee-85ec-9fc08b86bc18 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:52.121828 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 966/1897] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:51 2021] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:52.126193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e592a38-3545-466a-a779-a349f4b54f6c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:52.137221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e592a38-3545-466a-a779-a349f4b54f6c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:52.141774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84d8c-d6eb-4e5d-b3d2-20338b2cea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:52.142429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84d8c-d6eb-4e5d-b3d2-20338b2cea7a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.142736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84d8c-d6eb-4e5d-b3d2-20338b2cea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.143106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84d8c-d6eb-4e5d-b3d2-20338b2cea7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.143835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84d8c-d6eb-4e5d-b3d2-20338b2cea7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:52.145406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84d8c-d6eb-4e5d-b3d2-20338b2cea7a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:52.156142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 932/1898] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:52.160345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e429c-74c5-4cee-85ec-9fc08b86bc18 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:52.170654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e429c-74c5-4cee-85ec-9fc08b86bc18 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:52.175450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebb270-0eec-4efe-80cd-3c7c2c127760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:52.176176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb270-0eec-4efe-80cd-3c7c2c127760 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.176471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb270-0eec-4efe-80cd-3c7c2c127760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.176746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb270-0eec-4efe-80cd-3c7c2c127760 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.177514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebb270-0eec-4efe-80cd-3c7c2c127760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:52.179189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebb270-0eec-4efe-80cd-3c7c2c127760 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:52.190320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 967/1899] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:52.194453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84d8c-d6eb-4e5d-b3d2-20338b2cea7a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:52.204727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84d8c-d6eb-4e5d-b3d2-20338b2cea7a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:52.209354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f0ac7-d46d-40cd-b3fa-f5aed083be42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:52.210232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f0ac7-d46d-40cd-b3fa-f5aed083be42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.210510 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f0ac7-d46d-40cd-b3fa-f5aed083be42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.210828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f0ac7-d46d-40cd-b3fa-f5aed083be42 admin admin] PATH_INFO: `/v3/projects/4eea3ff8eb1642b18b640e8f86b34616/users/78380bb8e1e2406590fbc14302329bc3/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.226638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f0ac7-d46d-40cd-b3fa-f5aed083be42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eea3ff8eb1642b18b640e8f86b34616, user_id=78380bb8e1e2406590fbc14302329bc3, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:52.229283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f0ac7-d46d-40cd-b3fa-f5aed083be42 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:52.351305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 933/1900] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:52 2021] PUT /identity/v3/projects/4eea3ff8eb1642b18b640e8f86b34616/users/78380bb8e1e2406590fbc14302329bc3/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:52.362013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dafdb1-73fd-4a66-b688-a2d84a2054b6 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.362295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dafdb1-73fd-4a66-b688-a2d84a2054b6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.362589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dafdb1-73fd-4a66-b688-a2d84a2054b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.389149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b4dafdb1-73fd-4a66-b688-a2d84a2054b6 None None] MFA Rules not processed for user `78380bb8e1e2406590fbc14302329bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:52.390264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b4dafdb1-73fd-4a66-b688-a2d84a2054b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:52.456220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 968/1901] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:52 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:52.460798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f0ac7-d46d-40cd-b3fa-f5aed083be42 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:52.519772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f0ac7-d46d-40cd-b3fa-f5aed083be42 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:52.524674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff973-5471-4ab8-ac77-f371c1df912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:52.525333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff973-5471-4ab8-ac77-f371c1df912b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.525616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff973-5471-4ab8-ac77-f371c1df912b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.525896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff973-5471-4ab8-ac77-f371c1df912b admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.526631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acff973-5471-4ab8-ac77-f371c1df912b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:52.528563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acff973-5471-4ab8-ac77-f371c1df912b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:52.654777 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 934/1902] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:52 2021] POST /identity/v3/projects => generated 389 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:52.658706 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dafdb1-73fd-4a66-b688-a2d84a2054b6 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:52.669595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dafdb1-73fd-4a66-b688-a2d84a2054b6 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:52.722567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e98c7-cd11-41f0-8f92-0bf6d28e6b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:52.723223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e98c7-cd11-41f0-8f92-0bf6d28e6b8b admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.723493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e98c7-cd11-41f0-8f92-0bf6d28e6b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.723760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e98c7-cd11-41f0-8f92-0bf6d28e6b8b admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.724466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e98c7-cd11-41f0-8f92-0bf6d28e6b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:52.726365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e98c7-cd11-41f0-8f92-0bf6d28e6b8b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:52.815996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 969/1903] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:52 2021] POST /identity/v3/users => generated 301 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:52.817263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff973-5471-4ab8-ac77-f371c1df912b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:52.827688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff973-5471-4ab8-ac77-f371c1df912b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:52.832762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42861b26-626b-4f16-8bda-b014aebfc52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:52.833428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42861b26-626b-4f16-8bda-b014aebfc52d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.833704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42861b26-626b-4f16-8bda-b014aebfc52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.833980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42861b26-626b-4f16-8bda-b014aebfc52d admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.834768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42861b26-626b-4f16-8bda-b014aebfc52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:52.836357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42861b26-626b-4f16-8bda-b014aebfc52d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:52.847495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 935/1904] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:52.851724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e98c7-cd11-41f0-8f92-0bf6d28e6b8b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:52.862254 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e98c7-cd11-41f0-8f92-0bf6d28e6b8b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:52.866774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd0be-cc2b-456f-a4fb-c7eec25c281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:52.867675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd0be-cc2b-456f-a4fb-c7eec25c281e admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:52.867950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd0be-cc2b-456f-a4fb-c7eec25c281e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:52.868226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd0be-cc2b-456f-a4fb-c7eec25c281e admin admin] PATH_INFO: `/v3/projects/7d99c707d6024780a89fa8da013a8ead/users/f41b3752ff354a7a9646cb35956287d6/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:52.883843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebd0be-cc2b-456f-a4fb-c7eec25c281e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d99c707d6024780a89fa8da013a8ead, user_id=f41b3752ff354a7a9646cb35956287d6, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:52.886784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebd0be-cc2b-456f-a4fb-c7eec25c281e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:52.966110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 970/1905] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:52 2021] PUT /identity/v3/projects/7d99c707d6024780a89fa8da013a8ead/users/f41b3752ff354a7a9646cb35956287d6/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:52.970455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42861b26-626b-4f16-8bda-b014aebfc52d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:52.981217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42861b26-626b-4f16-8bda-b014aebfc52d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:53.034786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b2fce-9974-413f-a923-1e1619a5c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:53.035495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b2fce-9974-413f-a923-1e1619a5c62d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:53.035856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b2fce-9974-413f-a923-1e1619a5c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:53.036146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b2fce-9974-413f-a923-1e1619a5c62d admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:53.036894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b2fce-9974-413f-a923-1e1619a5c62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:53.038603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b2fce-9974-413f-a923-1e1619a5c62d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:53.049281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 936/1906] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:52 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:53.053712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd0be-cc2b-456f-a4fb-c7eec25c281e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:53.073201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd0be-cc2b-456f-a4fb-c7eec25c281e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:53.073201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:53.073201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:53.073201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:53.073574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] PATH_INFO: `/v3/projects/7d99c707d6024780a89fa8da013a8ead/users/f41b3752ff354a7a9646cb35956287d6/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:53.073574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d99c707d6024780a89fa8da013a8ead, user_id=f41b3752ff354a7a9646cb35956287d6, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:53.074862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:53.085425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 971/1907] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:53 2021] PUT /identity/v3/projects/7d99c707d6024780a89fa8da013a8ead/users/f41b3752ff354a7a9646cb35956287d6/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:53.095865 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398c15a-825e-433b-8795-a2b3bd0091dc None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:53.096154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398c15a-825e-433b-8795-a2b3bd0091dc None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:53.096436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398c15a-825e-433b-8795-a2b3bd0091dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:53.124016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4398c15a-825e-433b-8795-a2b3bd0091dc None None] MFA Rules not processed for user `f41b3752ff354a7a9646cb35956287d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:53.125307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4398c15a-825e-433b-8795-a2b3bd0091dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:53.192004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 937/1908] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:53 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:53.201927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:53.203667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:53.266700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0212d30-cfa8-465a-bfb8-f70649515ac6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:53.270598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384337f-7005-4644-86dc-09c3c3efdcdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:53.271244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384337f-7005-4644-86dc-09c3c3efdcdd service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:53.271520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384337f-7005-4644-86dc-09c3c3efdcdd service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:53.271790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384337f-7005-4644-86dc-09c3c3efdcdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:53.281164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384337f-7005-4644-86dc-09c3c3efdcdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:53.282655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384337f-7005-4644-86dc-09c3c3efdcdd service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:53.292501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 972/1909] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:53 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:53.422566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398c15a-825e-433b-8795-a2b3bd0091dc None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:53.498634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398c15a-825e-433b-8795-a2b3bd0091dc None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:53.503379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:53.504372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:53.504756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:53.505133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] PATH_INFO: `/v3/users/78380bb8e1e2406590fbc14302329bc3` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:53.506425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78380bb8e1e2406590fbc14302329bc3)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:53.508401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:53.723969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78380bb8e1e2406590fbc14302329bc3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:53.724526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78380bb8e1e2406590fbc14302329bc3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:53.725405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78380bb8e1e2406590fbc14302329bc3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:53.807827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78380bb8e1e2406590fbc14302329bc3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:53.819644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78380bb8e1e2406590fbc14302329bc3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:53.832452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 938/1910] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:53 2021] DELETE /identity/v3/users/78380bb8e1e2406590fbc14302329bc3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:53.837089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9827-c806-43d0-9828-675a2bb6d2c6 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:53.837581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9827-c806-43d0-9828-675a2bb6d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:53.837688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9827-c806-43d0-9828-675a2bb6d2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:53.855467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-f5bd9827-c806-43d0-9828-675a2bb6d2c6 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:53.856941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f5bd9827-c806-43d0-9828-675a2bb6d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:53.915307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 973/1911] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:53.925497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:53.927034 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:53.985311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c824be9-1c06-4862-af75-cc0d66925197 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:53.989648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63994b-4393-4892-8a8c-240ba60a3307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:53.990902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63994b-4393-4892-8a8c-240ba60a3307 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:53.991455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63994b-4393-4892-8a8c-240ba60a3307 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:53.991902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63994b-4393-4892-8a8c-240ba60a3307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:54.023797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63994b-4393-4892-8a8c-240ba60a3307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:54.025305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63994b-4393-4892-8a8c-240ba60a3307 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:54.036280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 939/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:54.689675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9827-c806-43d0-9828-675a2bb6d2c6 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:54.691672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f5bd9827-c806-43d0-9828-675a2bb6d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:54.709080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9827-c806-43d0-9828-675a2bb6d2c6 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:54.717256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:54.718326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:54.718650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:54.718941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] PATH_INFO: `/v3/projects/4eea3ff8eb1642b18b640e8f86b34616` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:54.720264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eea3ff8eb1642b18b640e8f86b34616)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:54.722359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:54.835184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eea3ff8eb1642b18b640e8f86b34616', 'request_id': 'req-63b2bea7-d046-4f56-8baf-b2bff046d3a2'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:54.927816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eea3ff8eb1642b18b640e8f86b34616', 'request_id': 'req-63b2bea7-d046-4f56-8baf-b2bff046d3a2'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:54.933834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eea3ff8eb1642b18b640e8f86b34616', 'request_id': 'req-63b2bea7-d046-4f56-8baf-b2bff046d3a2'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:54.945930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] The token cache is being invalidate because project 4eea3ff8eb1642b18b640e8f86b34616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:54.946216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:54.947545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:54.949351 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 974/1913] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:54 2021] DELETE /identity/v3/projects/4eea3ff8eb1642b18b640e8f86b34616 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:54.953459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63994b-4393-4892-8a8c-240ba60a3307 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:54.963975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63994b-4393-4892-8a8c-240ba60a3307 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:55.026592 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:55.027940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:55.030963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:55.031954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:55.032230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:55.032496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] PATH_INFO: `/v3/users/f41b3752ff354a7a9646cb35956287d6` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:55.033687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41b3752ff354a7a9646cb35956287d6)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:55.035706 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:55.047315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2bea7-d046-4f56-8baf-b2bff046d3a2 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:55.065673 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:55.066839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:55.067314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:55.067584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] PATH_INFO: `/v3/users/cc8d311f6847442e87b91d8fca62deba` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:55.069070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8d311f6847442e87b91d8fca62deba)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:55.072323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:55.284544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41b3752ff354a7a9646cb35956287d6'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.285380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41b3752ff354a7a9646cb35956287d6'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.286027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41b3752ff354a7a9646cb35956287d6'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.324755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8d311f6847442e87b91d8fca62deba'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.325405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8d311f6847442e87b91d8fca62deba'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.326795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8d311f6847442e87b91d8fca62deba'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.424845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41b3752ff354a7a9646cb35956287d6'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.440377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41b3752ff354a7a9646cb35956287d6'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.455584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 940/1914] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:54 2021] DELETE /identity/v3/users/f41b3752ff354a7a9646cb35956287d6 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:55.535968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:55.537381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:55.596895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8d311f6847442e87b91d8fca62deba'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.597085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58518-fd91-4d69-a906-9eae44296d2b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:55.597743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:55.598507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:55.598765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:55.599039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:55.601012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:55.605364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c51fe094-883a-4a6b-a4fa-b6e2f870291c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8d311f6847442e87b91d8fca62deba'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:55.618311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 975/1915] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:55 2021] DELETE /identity/v3/users/cc8d311f6847442e87b91d8fca62deba => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:55.622793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a296b-1d0b-48fb-92f6-a25aeced38b4 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:55.623080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a296b-1d0b-48fb-92f6-a25aeced38b4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:55.623536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a296b-1d0b-48fb-92f6-a25aeced38b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:55.640978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-237a296b-1d0b-48fb-92f6-a25aeced38b4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:55.642276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-237a296b-1d0b-48fb-92f6-a25aeced38b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:55.659935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:55.661400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:55.670490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 941/1916] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:55 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:14:55.700934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 976/1917] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:55.712139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:55.714303 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:55.777302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302561c-6618-473e-a86e-7a39f5571ccf service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:55.833864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9d7e9-a9f2-4cae-ae72-e6e8dbffd429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:55.834579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9d7e9-a9f2-4cae-ae72-e6e8dbffd429 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:55.835030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9d7e9-a9f2-4cae-ae72-e6e8dbffd429 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:55.835220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9d7e9-a9f2-4cae-ae72-e6e8dbffd429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:55.845942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9d7e9-a9f2-4cae-ae72-e6e8dbffd429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:55.847464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9d7e9-a9f2-4cae-ae72-e6e8dbffd429 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:55.869380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 942/1918] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:56.044962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a296b-1d0b-48fb-92f6-a25aeced38b4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:56.046810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-237a296b-1d0b-48fb-92f6-a25aeced38b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:56.065614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a296b-1d0b-48fb-92f6-a25aeced38b4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:56.072538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:56.073541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.073721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.074049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] PATH_INFO: `/v3/projects/7d99c707d6024780a89fa8da013a8ead` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.075792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d99c707d6024780a89fa8da013a8ead)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:56.077725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:56.238924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d99c707d6024780a89fa8da013a8ead', 'request_id': 'req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.345887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d99c707d6024780a89fa8da013a8ead', 'request_id': 'req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.353929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d99c707d6024780a89fa8da013a8ead', 'request_id': 'req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.388400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] The token cache is being invalidate because project 7d99c707d6024780a89fa8da013a8ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:56.388900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.389756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.391770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 977/1919] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:56 2021] DELETE /identity/v3/projects/7d99c707d6024780a89fa8da013a8ead => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:56.402386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94c93c-01db-4a36-8886-ebd77ea0ed8e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.402947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94c93c-01db-4a36-8886-ebd77ea0ed8e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.403032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94c93c-01db-4a36-8886-ebd77ea0ed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.436540 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6d94c93c-01db-4a36-8886-ebd77ea0ed8e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:56.439110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6d94c93c-01db-4a36-8886-ebd77ea0ed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:56.497029 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:56.499748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:56.514183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 943/1920] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:56.527712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742791b-8aab-4af9-add3-f8c5cb922f6d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.527974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742791b-8aab-4af9-add3-f8c5cb922f6d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.528259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742791b-8aab-4af9-add3-f8c5cb922f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.554349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9742791b-8aab-4af9-add3-f8c5cb922f6d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:56.555684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9742791b-8aab-4af9-add3-f8c5cb922f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:56.564206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 944/1921] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:56.568358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742791b-8aab-4af9-add3-f8c5cb922f6d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:56.578068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742791b-8aab-4af9-add3-f8c5cb922f6d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:56.580771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114fb48-fbfa-4a3f-8af1-3a508a9febaa admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:56.583171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:56.583911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.584264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.584609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.585543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:56.585829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:56.588332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:56.597194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:56.598313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.599085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.599376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] PATH_INFO: `/v3/projects/055e07cd619b4942b18ebc536afef402` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.603086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 945/1922] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:14:56.607467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055e07cd619b4942b18ebc536afef402)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:56.609663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:56.611131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:56.629597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131c24-db93-46ae-a047-ade152c9bb07 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:56.635333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0177f-9208-497d-8071-786523712f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:56.635997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0177f-9208-497d-8071-786523712f52 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.636454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0177f-9208-497d-8071-786523712f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.636724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0177f-9208-497d-8071-786523712f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.637440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0177f-9208-497d-8071-786523712f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:56.646746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0177f-9208-497d-8071-786523712f52 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:56.727024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 946/1923] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:56 2021] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:56.728210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0177f-9208-497d-8071-786523712f52 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:56.736060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055e07cd619b4942b18ebc536afef402', 'request_id': 'req-ec2b0d89-27e5-4b55-8981-9337922e17f7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.790326 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0177f-9208-497d-8071-786523712f52 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:56.795043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f6e59-d683-4033-9be4-c92d1ba44133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:56.795703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f6e59-d683-4033-9be4-c92d1ba44133 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.795984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f6e59-d683-4033-9be4-c92d1ba44133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.796256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f6e59-d683-4033-9be4-c92d1ba44133 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.797003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f6e59-d683-4033-9be4-c92d1ba44133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:56.798989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f6e59-d683-4033-9be4-c92d1ba44133 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:56.830308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055e07cd619b4942b18ebc536afef402', 'request_id': 'req-ec2b0d89-27e5-4b55-8981-9337922e17f7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.836456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055e07cd619b4942b18ebc536afef402', 'request_id': 'req-ec2b0d89-27e5-4b55-8981-9337922e17f7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.847407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] The token cache is being invalidate because project 055e07cd619b4942b18ebc536afef402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:14:56.847616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.848258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ec2b0d89-27e5-4b55-8981-9337922e17f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:56.849794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 978/1924] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:14:56 2021] DELETE /identity/v3/projects/055e07cd619b4942b18ebc536afef402 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:56.855740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1082e-e290-40de-9a61-cb9118ea2d5d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.856024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1082e-e290-40de-9a61-cb9118ea2d5d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.856302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1082e-e290-40de-9a61-cb9118ea2d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.873903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9ba1082e-e290-40de-9a61-cb9118ea2d5d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:56.875131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9ba1082e-e290-40de-9a61-cb9118ea2d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:56.883100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 979/1925] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:56.917698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 947/1926] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:56 2021] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:56.922042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1082e-e290-40de-9a61-cb9118ea2d5d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:56.923562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9ba1082e-e290-40de-9a61-cb9118ea2d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:56.930001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4fcbc-5263-41f2-af51-91c6afe50278 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.930324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4fcbc-5263-41f2-af51-91c6afe50278 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.930628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4fcbc-5263-41f2-af51-91c6afe50278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.936362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1082e-e290-40de-9a61-cb9118ea2d5d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:56.941245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cea8c9-3e93-4edb-a46f-2724ce2731cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:56.941903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cea8c9-3e93-4edb-a46f-2724ce2731cf admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.942181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cea8c9-3e93-4edb-a46f-2724ce2731cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.942450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cea8c9-3e93-4edb-a46f-2724ce2731cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.943542 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cea8c9-3e93-4edb-a46f-2724ce2731cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:56.944898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cea8c9-3e93-4edb-a46f-2724ce2731cf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:56.950862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9fe4fcbc-5263-41f2-af51-91c6afe50278 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:56.956098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9fe4fcbc-5263-41f2-af51-91c6afe50278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:56.960511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 980/1927] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:56 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:56.960661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 948/1928] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:56.962422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cea8c9-3e93-4edb-a46f-2724ce2731cf admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:56.965279 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4fcbc-5263-41f2-af51-91c6afe50278 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:56.972874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cea8c9-3e93-4edb-a46f-2724ce2731cf admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:56.976358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4fcbc-5263-41f2-af51-91c6afe50278 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:56.980743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0249-0f61-4c1c-a303-ed2a4a3a5dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:56.981343 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:56.981459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0249-0f61-4c1c-a303-ed2a4a3a5dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.981680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0249-0f61-4c1c-a303-ed2a4a3a5dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.982024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0249-0f61-4c1c-a303-ed2a4a3a5dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.982129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:56.982333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:56.982653 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:56.982850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c0249-0f61-4c1c-a303-ed2a4a3a5dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:56.983544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:14:56.983844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:56.984375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c0249-0f61-4c1c-a303-ed2a4a3a5dc8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:56.985437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:56.995167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 981/1929] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:56 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:57.000855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 949/1930] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:14:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:14:57.000997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0249-0f61-4c1c-a303-ed2a4a3a5dc8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:57.001712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:57.010171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0249-0f61-4c1c-a303-ed2a4a3a5dc8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:57.011710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1946d-96a2-469b-aee0-3139fd9b6fb4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:57.014912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf9a5d-7018-499c-8671-0310ce81c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:57.015816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9a5d-7018-499c-8671-0310ce81c7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.016119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9a5d-7018-499c-8671-0310ce81c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.016320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fded3c-432e-439e-b69c-8d247e6233cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:57.016471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf9a5d-7018-499c-8671-0310ce81c7d2 admin admin] PATH_INFO: `/v3/projects/62e88ea9868543be9ea642bd11db4961/users/2b16648a55ee47adb2f0a0766d48a9f8/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.016963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fded3c-432e-439e-b69c-8d247e6233cf admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.017246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fded3c-432e-439e-b69c-8d247e6233cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.017520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fded3c-432e-439e-b69c-8d247e6233cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.018218 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fded3c-432e-439e-b69c-8d247e6233cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:57.020144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fded3c-432e-439e-b69c-8d247e6233cf admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:57.036746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf9a5d-7018-499c-8671-0310ce81c7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e88ea9868543be9ea642bd11db4961, user_id=2b16648a55ee47adb2f0a0766d48a9f8, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:57.039778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf9a5d-7018-499c-8671-0310ce81c7d2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:57.128615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 950/1931] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:57 2021] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:57.132675 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fded3c-432e-439e-b69c-8d247e6233cf admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:57.197094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 982/1932] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:56 2021] PUT /identity/v3/projects/62e88ea9868543be9ea642bd11db4961/users/2b16648a55ee47adb2f0a0766d48a9f8/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:14:57.206408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c767442-48c2-48fd-95da-8e742b462f4c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.206881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c767442-48c2-48fd-95da-8e742b462f4c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.207318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c767442-48c2-48fd-95da-8e742b462f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.232128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fded3c-432e-439e-b69c-8d247e6233cf admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:57.236587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2c767442-48c2-48fd-95da-8e742b462f4c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:57.237836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2c767442-48c2-48fd-95da-8e742b462f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:57.295472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b0f3a-34eb-4de0-90fd-266b9dd4e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:57.296273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b0f3a-34eb-4de0-90fd-266b9dd4e8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.296556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b0f3a-34eb-4de0-90fd-266b9dd4e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.296987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b0f3a-34eb-4de0-90fd-266b9dd4e8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.297930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b0f3a-34eb-4de0-90fd-266b9dd4e8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:57.300511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b0f3a-34eb-4de0-90fd-266b9dd4e8d5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:57.303999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 983/1933] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:57.322685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c767442-48c2-48fd-95da-8e742b462f4c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:57.326534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2c767442-48c2-48fd-95da-8e742b462f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:57.411885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c767442-48c2-48fd-95da-8e742b462f4c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:57.425529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82981e9b-0201-4098-8e78-43bece81e65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:57.426389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82981e9b-0201-4098-8e78-43bece81e65b service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.426756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82981e9b-0201-4098-8e78-43bece81e65b service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.427101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82981e9b-0201-4098-8e78-43bece81e65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.443821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82981e9b-0201-4098-8e78-43bece81e65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:57.445413 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82981e9b-0201-4098-8e78-43bece81e65b service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:57.456127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 984/1934] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:57.494339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 951/1935] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:57 2021] POST /identity/v3/users => generated 291 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:57.499221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82981e9b-0201-4098-8e78-43bece81e65b service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:57.511308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82981e9b-0201-4098-8e78-43bece81e65b service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:57.516511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705bdfc-5da2-4cfa-adea-89813d9fe3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:57.517259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705bdfc-5da2-4cfa-adea-89813d9fe3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.517723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705bdfc-5da2-4cfa-adea-89813d9fe3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.518072 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705bdfc-5da2-4cfa-adea-89813d9fe3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.519047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705bdfc-5da2-4cfa-adea-89813d9fe3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:57.520822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705bdfc-5da2-4cfa-adea-89813d9fe3b6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:57.536122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 985/1936] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:57 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:57.541265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b0f3a-34eb-4de0-90fd-266b9dd4e8d5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:57.556514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b0f3a-34eb-4de0-90fd-266b9dd4e8d5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:57.562583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bed49-b08e-48a5-accd-f01b62bcf8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:57.563392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bed49-b08e-48a5-accd-f01b62bcf8bf admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.563668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bed49-b08e-48a5-accd-f01b62bcf8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.563958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bed49-b08e-48a5-accd-f01b62bcf8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.564687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bed49-b08e-48a5-accd-f01b62bcf8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:57.566781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bed49-b08e-48a5-accd-f01b62bcf8bf admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:57.578220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 952/1937] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:57 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:57.582489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705bdfc-5da2-4cfa-adea-89813d9fe3b6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:57.594114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705bdfc-5da2-4cfa-adea-89813d9fe3b6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:57.599476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81166f1a-b917-431f-a9da-bf3922607a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:57.600057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166f1a-b917-431f-a9da-bf3922607a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.600237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166f1a-b917-431f-a9da-bf3922607a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.601165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166f1a-b917-431f-a9da-bf3922607a88 admin admin] PATH_INFO: `/v3/projects/93c65dab3af24997b6ad6ca5f3a4e04c/users/90bb93dfe0aa4bffb419eee9a18b9994/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.616737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81166f1a-b917-431f-a9da-bf3922607a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c65dab3af24997b6ad6ca5f3a4e04c, user_id=90bb93dfe0aa4bffb419eee9a18b9994, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:57.619611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81166f1a-b917-431f-a9da-bf3922607a88 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:57.816548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 986/1938] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:57 2021] PUT /identity/v3/projects/93c65dab3af24997b6ad6ca5f3a4e04c/users/90bb93dfe0aa4bffb419eee9a18b9994/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:57.827038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe90ed-1e32-4140-b936-9cc89ec6893e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:57.827455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe90ed-1e32-4140-b936-9cc89ec6893e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:57.828324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe90ed-1e32-4140-b936-9cc89ec6893e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:57.868900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-bafe90ed-1e32-4140-b936-9cc89ec6893e None None] MFA Rules not processed for user `90bb93dfe0aa4bffb419eee9a18b9994`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:57.870256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bafe90ed-1e32-4140-b936-9cc89ec6893e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:57.957468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 953/1939] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:57.961863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81166f1a-b917-431f-a9da-bf3922607a88 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:58.026323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81166f1a-b917-431f-a9da-bf3922607a88 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:58.031669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdce61-f2a8-4f85-b035-2487e9a230fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:58.032751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdce61-f2a8-4f85-b035-2487e9a230fa admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:58.033135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdce61-f2a8-4f85-b035-2487e9a230fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:58.033579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdce61-f2a8-4f85-b035-2487e9a230fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:58.034600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdce61-f2a8-4f85-b035-2487e9a230fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:58.036607 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdce61-f2a8-4f85-b035-2487e9a230fa admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:58.184359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 987/1940] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:57 2021] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:58.185422 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe90ed-1e32-4140-b936-9cc89ec6893e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:58.196096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe90ed-1e32-4140-b936-9cc89ec6893e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:58.278876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927114-365b-4459-9c5b-ec0fda82c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:58.280605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927114-365b-4459-9c5b-ec0fda82c9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:58.280901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927114-365b-4459-9c5b-ec0fda82c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:58.281377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927114-365b-4459-9c5b-ec0fda82c9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:58.282276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d927114-365b-4459-9c5b-ec0fda82c9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:58.293626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d927114-365b-4459-9c5b-ec0fda82c9a5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:58.493404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 954/1941] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:58 2021] POST /identity/v3/users => generated 296 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:14:58.497360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdce61-f2a8-4f85-b035-2487e9a230fa admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:58.507564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdce61-f2a8-4f85-b035-2487e9a230fa admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:58.512118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7c97f-ec99-48d3-a05a-6ea6100a5853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:58.512760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c97f-ec99-48d3-a05a-6ea6100a5853 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:58.513039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c97f-ec99-48d3-a05a-6ea6100a5853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:58.513310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c97f-ec99-48d3-a05a-6ea6100a5853 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:58.514031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7c97f-ec99-48d3-a05a-6ea6100a5853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:58.515686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7c97f-ec99-48d3-a05a-6ea6100a5853 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:58.527725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 988/1942] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:14:58.531963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927114-365b-4459-9c5b-ec0fda82c9a5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:58.569669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927114-365b-4459-9c5b-ec0fda82c9a5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:58.574646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854bb3f-e001-4f18-bd35-0047c0833958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:58.575544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854bb3f-e001-4f18-bd35-0047c0833958 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:58.575827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854bb3f-e001-4f18-bd35-0047c0833958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:58.576133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854bb3f-e001-4f18-bd35-0047c0833958 admin admin] PATH_INFO: `/v3/projects/8536159851614a99a94063b59f578b45/users/1bb5e34d1e90456dbb3c689a178b6739/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:58.592025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854bb3f-e001-4f18-bd35-0047c0833958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8536159851614a99a94063b59f578b45, user_id=1bb5e34d1e90456dbb3c689a178b6739, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:58.594701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854bb3f-e001-4f18-bd35-0047c0833958 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:58.721395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 955/1943] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:58 2021] PUT /identity/v3/projects/8536159851614a99a94063b59f578b45/users/1bb5e34d1e90456dbb3c689a178b6739/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:58.722066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7c97f-ec99-48d3-a05a-6ea6100a5853 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:58.732624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7c97f-ec99-48d3-a05a-6ea6100a5853 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:58.793405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d06a7e-357d-49d6-9062-b67960379fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:58.794157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06a7e-357d-49d6-9062-b67960379fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:58.794450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06a7e-357d-49d6-9062-b67960379fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:58.794799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06a7e-357d-49d6-9062-b67960379fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:58.795538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d06a7e-357d-49d6-9062-b67960379fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:58.797359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d06a7e-357d-49d6-9062-b67960379fcb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:58.807838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 989/1944] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:58 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:58.812050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854bb3f-e001-4f18-bd35-0047c0833958 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:58.823246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854bb3f-e001-4f18-bd35-0047c0833958 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:58.828115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63e874-55af-4c16-9887-c9aa9bb6c201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:58.829379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63e874-55af-4c16-9887-c9aa9bb6c201 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:58.829687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63e874-55af-4c16-9887-c9aa9bb6c201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:58.830055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63e874-55af-4c16-9887-c9aa9bb6c201 admin admin] PATH_INFO: `/v3/projects/8536159851614a99a94063b59f578b45/users/1bb5e34d1e90456dbb3c689a178b6739/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:58.832390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63e874-55af-4c16-9887-c9aa9bb6c201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8536159851614a99a94063b59f578b45, user_id=1bb5e34d1e90456dbb3c689a178b6739, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:58.840006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63e874-55af-4c16-9887-c9aa9bb6c201 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:58.854299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 956/1945] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:58 2021] PUT /identity/v3/projects/8536159851614a99a94063b59f578b45/users/1bb5e34d1e90456dbb3c689a178b6739/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:58.868297 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a6b6-45bd-4962-bca0-03c0075a5325 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:58.869446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a6b6-45bd-4962-bca0-03c0075a5325 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:58.869888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3a6b6-45bd-4962-bca0-03c0075a5325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:58.905556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-1df3a6b6-45bd-4962-bca0-03c0075a5325 None None] MFA Rules not processed for user `1bb5e34d1e90456dbb3c689a178b6739`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:58.907614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1df3a6b6-45bd-4962-bca0-03c0075a5325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:58.996971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 990/1946] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:58 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:14:58.998383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63e874-55af-4c16-9887-c9aa9bb6c201 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:59.120725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63e874-55af-4c16-9887-c9aa9bb6c201 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:59.127580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:59.129404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:59.130149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:59.130590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] PATH_INFO: `/v3/users/90bb93dfe0aa4bffb419eee9a18b9994` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:59.132139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bb93dfe0aa4bffb419eee9a18b9994)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:59.135824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:59.233006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c25e-617d-472e-8e9f-f18154da2be3 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:59.234918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c25e-617d-472e-8e9f-f18154da2be3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:59.235400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c25e-617d-472e-8e9f-f18154da2be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:59.267309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9e99c25e-617d-472e-8e9f-f18154da2be3 None None] MFA Rules not processed for user `2b16648a55ee47adb2f0a0766d48a9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:59.268445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9e99c25e-617d-472e-8e9f-f18154da2be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:59.362238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bb93dfe0aa4bffb419eee9a18b9994'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:59.365549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bb93dfe0aa4bffb419eee9a18b9994'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:59.366503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bb93dfe0aa4bffb419eee9a18b9994'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:59.369341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 991/1947] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:59 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:59.375545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99c25e-617d-472e-8e9f-f18154da2be3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:59.389914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99c25e-617d-472e-8e9f-f18154da2be3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:59.398588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:59.400126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:59.400484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:59.403176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:59.403176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:59.405796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:59.494998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bb93dfe0aa4bffb419eee9a18b9994'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:59.533368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-36dada38-5b1f-4ea7-ba3e-b689d9688ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bb93dfe0aa4bffb419eee9a18b9994'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:14:59.548276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 992/1948] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:14:59 2021] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:59.549281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:59.550970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 957/1949] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:14:58 2021] DELETE /identity/v3/users/90bb93dfe0aa4bffb419eee9a18b9994 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:14:59.553759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:59.555880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823d17-4b5a-405c-b76e-f4dd2cfc0f88 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:59.556369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823d17-4b5a-405c-b76e-f4dd2cfc0f88 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:59.556628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38823d17-4b5a-405c-b76e-f4dd2cfc0f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:59.586760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-38823d17-4b5a-405c-b76e-f4dd2cfc0f88 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:14:59.589000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-38823d17-4b5a-405c-b76e-f4dd2cfc0f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:59.651434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22cb93-2abb-4f05-b8fa-28b006dd7bbb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:59.667488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 958/1950] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:14:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:14:59.677663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38823d17-4b5a-405c-b76e-f4dd2cfc0f88 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:59.679400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-38823d17-4b5a-405c-b76e-f4dd2cfc0f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:14:59.734749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de94c0-b4a5-4f89-b80c-5dade5a0d87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:59.739992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de94c0-b4a5-4f89-b80c-5dade5a0d87d admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:59.739992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de94c0-b4a5-4f89-b80c-5dade5a0d87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:59.739992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de94c0-b4a5-4f89-b80c-5dade5a0d87d admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:59.739992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de94c0-b4a5-4f89-b80c-5dade5a0d87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:59.739992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de94c0-b4a5-4f89-b80c-5dade5a0d87d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:59.754377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38823d17-4b5a-405c-b76e-f4dd2cfc0f88 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:59.758283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe52f-153c-4619-9a94-ed99f3310a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:59.759538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe52f-153c-4619-9a94-ed99f3310a15 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:59.759825 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe52f-153c-4619-9a94-ed99f3310a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:59.760099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fe52f-153c-4619-9a94-ed99f3310a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:59.769784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fe52f-153c-4619-9a94-ed99f3310a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:59.771373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fe52f-153c-4619-9a94-ed99f3310a15 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:59.782410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 959/1951] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:14:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:14:59.874079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 993/1952] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:14:59 2021] POST /identity/v3/users => generated 292 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:14:59.886685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe52f-153c-4619-9a94-ed99f3310a15 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:59.896514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fe52f-153c-4619-9a94-ed99f3310a15 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:59.905909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8741904-752b-4370-ab20-36c9a3a3ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:59.905909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8741904-752b-4370-ab20-36c9a3a3ab58 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:59.905909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8741904-752b-4370-ab20-36c9a3a3ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:59.905909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8741904-752b-4370-ab20-36c9a3a3ab58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:59.912532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8741904-752b-4370-ab20-36c9a3a3ab58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:59.912532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8741904-752b-4370-ab20-36c9a3a3ab58 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:14:59.917404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 960/1953] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:14:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:14:59.921277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de94c0-b4a5-4f89-b80c-5dade5a0d87d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:14:59.931840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de94c0-b4a5-4f89-b80c-5dade5a0d87d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:14:59.936931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338207d-7384-4a22-bd49-50ea6424e0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:14:59.937933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338207d-7384-4a22-bd49-50ea6424e0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:14:59.938385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338207d-7384-4a22-bd49-50ea6424e0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:14:59.938691 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338207d-7384-4a22-bd49-50ea6424e0f9 admin admin] PATH_INFO: `/v3/projects/e76706615e434c6083c33022dc1a2a93/users/b588b4c1bb6d413589059eeec1515a6f/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:14:59.954390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338207d-7384-4a22-bd49-50ea6424e0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76706615e434c6083c33022dc1a2a93, user_id=b588b4c1bb6d413589059eeec1515a6f, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:14:59.957105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338207d-7384-4a22-bd49-50ea6424e0f9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:00.063188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 994/1954] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:14:59 2021] PUT /identity/v3/projects/e76706615e434c6083c33022dc1a2a93/users/b588b4c1bb6d413589059eeec1515a6f/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:00.064250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8741904-752b-4370-ab20-36c9a3a3ab58 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:00.077317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8741904-752b-4370-ab20-36c9a3a3ab58 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:00.159940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:00.160875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:00.161293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:00.161535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:00.162286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:00.164241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:00.176379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 961/1955] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:00 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:00.181553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338207d-7384-4a22-bd49-50ea6424e0f9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:00.192086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338207d-7384-4a22-bd49-50ea6424e0f9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:00.198638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:00.199732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:00.200103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:00.200374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] PATH_INFO: `/v3/projects/e76706615e434c6083c33022dc1a2a93/users/b588b4c1bb6d413589059eeec1515a6f/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:00.202459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76706615e434c6083c33022dc1a2a93, user_id=b588b4c1bb6d413589059eeec1515a6f, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:00.206816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:00.216711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 995/1956] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:00 2021] PUT /identity/v3/projects/e76706615e434c6083c33022dc1a2a93/users/b588b4c1bb6d413589059eeec1515a6f/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:00.289070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:00.291449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:00.315931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099c9b-050b-4d5d-b6db-a5411546374e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:00.407414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:00.410525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:00.410525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:00.410525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] PATH_INFO: `/v3/projects/93c65dab3af24997b6ad6ca5f3a4e04c` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:00.412094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c65dab3af24997b6ad6ca5f3a4e04c)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:00.416082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:00.566290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c65dab3af24997b6ad6ca5f3a4e04c', 'request_id': 'req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:00.698974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c65dab3af24997b6ad6ca5f3a4e04c', 'request_id': 'req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:00.704941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c65dab3af24997b6ad6ca5f3a4e04c', 'request_id': 'req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:00.715649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] The token cache is being invalidate because project 93c65dab3af24997b6ad6ca5f3a4e04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:00.715940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:00.716570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:00.718106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 962/1957] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:00 2021] DELETE /identity/v3/projects/93c65dab3af24997b6ad6ca5f3a4e04c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:00.722098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:00.723842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:00.736529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265431-1128-452e-973c-37e635e084c9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:00.792607 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:00.793670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:00.793963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:00.794258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] PATH_INFO: `/v3/users/1bb5e34d1e90456dbb3c689a178b6739` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:00.795739 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb5e34d1e90456dbb3c689a178b6739)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:00.797773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:01.017366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb5e34d1e90456dbb3c689a178b6739'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:01.018048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb5e34d1e90456dbb3c689a178b6739'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:01.018687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb5e34d1e90456dbb3c689a178b6739'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:01.105050 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb5e34d1e90456dbb3c689a178b6739'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:01.123523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-47a03d7a-224c-43a5-81a5-7ee7cc30accf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb5e34d1e90456dbb3c689a178b6739'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:01.136647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 996/1958] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:00 2021] DELETE /identity/v3/users/1bb5e34d1e90456dbb3c689a178b6739 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:01.677871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:01.689202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc0664-2517-42ad-b719-c3b4c8dab2f8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:01.791588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:01.793062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:01.793343 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:01.797570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] PATH_INFO: `/v3/projects/8536159851614a99a94063b59f578b45` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:01.797570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8536159851614a99a94063b59f578b45)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:01.797570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:01.913224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414148d8-bd4c-4575-b7f0-7ac6b8c31b3b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:01.915642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414148d8-bd4c-4575-b7f0-7ac6b8c31b3b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:01.915953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414148d8-bd4c-4575-b7f0-7ac6b8c31b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:01.939516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8536159851614a99a94063b59f578b45', 'request_id': 'req-90803a4c-883f-480b-81f4-a49e244e4a50'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:01.946219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-414148d8-bd4c-4575-b7f0-7ac6b8c31b3b None None] MFA Rules not processed for user `b588b4c1bb6d413589059eeec1515a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:01.948142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-414148d8-bd4c-4575-b7f0-7ac6b8c31b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:02.029161 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 997/1959] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:01 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:02.030594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8536159851614a99a94063b59f578b45', 'request_id': 'req-90803a4c-883f-480b-81f4-a49e244e4a50'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:02.038191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8536159851614a99a94063b59f578b45', 'request_id': 'req-90803a4c-883f-480b-81f4-a49e244e4a50'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:02.042687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414148d8-bd4c-4575-b7f0-7ac6b8c31b3b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:02.044636 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-414148d8-bd4c-4575-b7f0-7ac6b8c31b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:02.052927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] The token cache is being invalidate because project 8536159851614a99a94063b59f578b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:02.053215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:02.054225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-90803a4c-883f-480b-81f4-a49e244e4a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:02.057147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 963/1960] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:01 2021] DELETE /identity/v3/projects/8536159851614a99a94063b59f578b45 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:02.063595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d653-8c79-420f-a083-69ea8d163f44 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.064091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d653-8c79-420f-a083-69ea8d163f44 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.064432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7d653-8c79-420f-a083-69ea8d163f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.086852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-69b7d653-8c79-420f-a083-69ea8d163f44 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:02.088605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-69b7d653-8c79-420f-a083-69ea8d163f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:02.122254 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414148d8-bd4c-4575-b7f0-7ac6b8c31b3b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:02.126893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:02.127852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.128624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.129220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.131713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:02.226172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 964/1961] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:02.231936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:02.233735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:02.246749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878104f-fb8b-44da-8662-049e2788c1d1 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.247732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 998/1962] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:02 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:02.256882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878104f-fb8b-44da-8662-049e2788c1d1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.263676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878104f-fb8b-44da-8662-049e2788c1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.281959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-0878104f-fb8b-44da-8662-049e2788c1d1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:02.283708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0878104f-fb8b-44da-8662-049e2788c1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:02.293794 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 965/1963] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:02.297735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:02.310363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e660e0-387b-4a0a-801b-f35c19e5c5fe service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:02.320908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:02.320908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.320908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.320908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.321302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:02.321302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:02.323036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:02.338578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 999/1964] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:02.344026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878104f-fb8b-44da-8662-049e2788c1d1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:02.355934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878104f-fb8b-44da-8662-049e2788c1d1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:02.360860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c5d59-5f60-41b7-b824-d7f72cf2018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:02.361031 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5d59-5f60-41b7-b824-d7f72cf2018a admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.361253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5d59-5f60-41b7-b824-d7f72cf2018a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.361523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c5d59-5f60-41b7-b824-d7f72cf2018a admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.362744 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c5d59-5f60-41b7-b824-d7f72cf2018a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:02.364669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c5d59-5f60-41b7-b824-d7f72cf2018a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:02.529338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 966/1965] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:02 2021] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:02.534696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:02.543721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf89f7-0f79-4927-8ff8-fb5971cec359 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:02.616815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecccbf-c683-4f55-a6ed-c47909a3b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:02.617609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecccbf-c683-4f55-a6ed-c47909a3b8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.617816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecccbf-c683-4f55-a6ed-c47909a3b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.618097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecccbf-c683-4f55-a6ed-c47909a3b8e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.619793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecccbf-c683-4f55-a6ed-c47909a3b8e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:02.621749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecccbf-c683-4f55-a6ed-c47909a3b8e3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:02.780478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1000/1966] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:02 2021] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:02.784674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c5d59-5f60-41b7-b824-d7f72cf2018a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:02.795715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c5d59-5f60-41b7-b824-d7f72cf2018a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:02.800334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9c1a-8d0d-400a-a50c-e8dc240551c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:02.800982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9c1a-8d0d-400a-a50c-e8dc240551c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.801263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9c1a-8d0d-400a-a50c-e8dc240551c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.801536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9c1a-8d0d-400a-a50c-e8dc240551c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.802275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9c1a-8d0d-400a-a50c-e8dc240551c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:02.803881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9c1a-8d0d-400a-a50c-e8dc240551c6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:02.814347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 967/1967] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:02.818553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecccbf-c683-4f55-a6ed-c47909a3b8e3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:02.828552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecccbf-c683-4f55-a6ed-c47909a3b8e3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:02.833332 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1956-186b-4233-8f1b-1fbfff7bdaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:02.833989 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1956-186b-4233-8f1b-1fbfff7bdaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.834272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1956-186b-4233-8f1b-1fbfff7bdaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.834556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1956-186b-4233-8f1b-1fbfff7bdaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.839516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1956-186b-4233-8f1b-1fbfff7bdaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:02.841735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1956-186b-4233-8f1b-1fbfff7bdaf2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:02.855925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1001/1968] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:02.860141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9c1a-8d0d-400a-a50c-e8dc240551c6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:02.870056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9c1a-8d0d-400a-a50c-e8dc240551c6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:02.874664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f230576-17ea-4444-81df-5ce22124c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:02.875481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f230576-17ea-4444-81df-5ce22124c501 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:02.875757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f230576-17ea-4444-81df-5ce22124c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:02.876027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f230576-17ea-4444-81df-5ce22124c501 admin admin] PATH_INFO: `/v3/projects/aa3cf3fdd8cc4c4681e569ad7521a2fe/users/0310642a7f6f46ea945bdde1e692ff7b/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:02.892060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f230576-17ea-4444-81df-5ce22124c501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3cf3fdd8cc4c4681e569ad7521a2fe, user_id=0310642a7f6f46ea945bdde1e692ff7b, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:02.894930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f230576-17ea-4444-81df-5ce22124c501 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:02.990941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 968/1969] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:02 2021] PUT /identity/v3/projects/aa3cf3fdd8cc4c4681e569ad7521a2fe/users/0310642a7f6f46ea945bdde1e692ff7b/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:03.001426 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa4e0-1eda-4010-a1f2-69db87dfdfe6 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:03.001965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa4e0-1eda-4010-a1f2-69db87dfdfe6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:03.001965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa4e0-1eda-4010-a1f2-69db87dfdfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:03.036414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-cccaa4e0-1eda-4010-a1f2-69db87dfdfe6 None None] MFA Rules not processed for user `0310642a7f6f46ea945bdde1e692ff7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:03.036414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-cccaa4e0-1eda-4010-a1f2-69db87dfdfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:03.103659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1002/1970] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:02 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:03.109021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f230576-17ea-4444-81df-5ce22124c501 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:03.178406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f230576-17ea-4444-81df-5ce22124c501 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:03.183356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037cc3-8f40-433c-93e9-9a4588eaa444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:03.184087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037cc3-8f40-433c-93e9-9a4588eaa444 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:03.184379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037cc3-8f40-433c-93e9-9a4588eaa444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:03.184652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037cc3-8f40-433c-93e9-9a4588eaa444 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:03.185605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e037cc3-8f40-433c-93e9-9a4588eaa444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:03.187769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e037cc3-8f40-433c-93e9-9a4588eaa444 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:03.300730 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 969/1971] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:03 2021] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:03.304479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa4e0-1eda-4010-a1f2-69db87dfdfe6 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:03.316621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa4e0-1eda-4010-a1f2-69db87dfdfe6 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:03.373609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdf8f-f9fe-4ee4-8793-a71a139f5a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:03.374353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdf8f-f9fe-4ee4-8793-a71a139f5a43 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:03.374672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdf8f-f9fe-4ee4-8793-a71a139f5a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:03.374942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdf8f-f9fe-4ee4-8793-a71a139f5a43 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:03.375646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fdf8f-f9fe-4ee4-8793-a71a139f5a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:03.377561 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fdf8f-f9fe-4ee4-8793-a71a139f5a43 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:03.517284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1003/1972] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:03 2021] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:03.521032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037cc3-8f40-433c-93e9-9a4588eaa444 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:03.533403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037cc3-8f40-433c-93e9-9a4588eaa444 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:03.537251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3600-f2ce-431c-97b7-8b79f1df1983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:03.542265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3600-f2ce-431c-97b7-8b79f1df1983 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:03.542265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3600-f2ce-431c-97b7-8b79f1df1983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:03.542265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3600-f2ce-431c-97b7-8b79f1df1983 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:03.542265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac3600-f2ce-431c-97b7-8b79f1df1983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:03.542265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac3600-f2ce-431c-97b7-8b79f1df1983 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:03.557875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 970/1973] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:03.562034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdf8f-f9fe-4ee4-8793-a71a139f5a43 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:03.573134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdf8f-f9fe-4ee4-8793-a71a139f5a43 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:03.580139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e01c6-68b7-4ae3-8576-c0afa66d9e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:03.581039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e01c6-68b7-4ae3-8576-c0afa66d9e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:03.581337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e01c6-68b7-4ae3-8576-c0afa66d9e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:03.581626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e01c6-68b7-4ae3-8576-c0afa66d9e9c admin admin] PATH_INFO: `/v3/projects/f4d6d06bb99843b9abbd68f3d2730c48/users/cbb211516c194878a376ba83f89da23e/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:03.597173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e01c6-68b7-4ae3-8576-c0afa66d9e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d6d06bb99843b9abbd68f3d2730c48, user_id=cbb211516c194878a376ba83f89da23e, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:03.600502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e01c6-68b7-4ae3-8576-c0afa66d9e9c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:03.789992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1004/1974] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:03 2021] PUT /identity/v3/projects/f4d6d06bb99843b9abbd68f3d2730c48/users/cbb211516c194878a376ba83f89da23e/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:03.794008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3600-f2ce-431c-97b7-8b79f1df1983 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:03.803905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3600-f2ce-431c-97b7-8b79f1df1983 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:03.860068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed40c8-92ab-471e-a6a6-09530a03eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:03.860734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed40c8-92ab-471e-a6a6-09530a03eed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:03.861016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed40c8-92ab-471e-a6a6-09530a03eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:03.861290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed40c8-92ab-471e-a6a6-09530a03eed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:03.862076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed40c8-92ab-471e-a6a6-09530a03eed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:03.863719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed40c8-92ab-471e-a6a6-09530a03eed4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:03.874306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 971/1975] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:03 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:03.878481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e01c6-68b7-4ae3-8576-c0afa66d9e9c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:03.888779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e01c6-68b7-4ae3-8576-c0afa66d9e9c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:03.893376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:03.894256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:03.894533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:03.894842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] PATH_INFO: `/v3/projects/f4d6d06bb99843b9abbd68f3d2730c48/users/cbb211516c194878a376ba83f89da23e/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:03.896898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d6d06bb99843b9abbd68f3d2730c48, user_id=cbb211516c194878a376ba83f89da23e, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:03.899587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:03.909977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1005/1976] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:03 2021] PUT /identity/v3/projects/f4d6d06bb99843b9abbd68f3d2730c48/users/cbb211516c194878a376ba83f89da23e/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:03.922059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d71c31-0145-488c-9946-6cc5a213c4e2 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:03.922348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d71c31-0145-488c-9946-6cc5a213c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:03.922659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d71c31-0145-488c-9946-6cc5a213c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:03.950119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-87d71c31-0145-488c-9946-6cc5a213c4e2 None None] MFA Rules not processed for user `cbb211516c194878a376ba83f89da23e`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:03.951351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-87d71c31-0145-488c-9946-6cc5a213c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:04.020594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 972/1977] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:03 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:04.031031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:04.032749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:04.091958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c73e-cbc6-4133-81fb-93888a7ee6f4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:04.095743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:04.096398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:04.096682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:04.096959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:04.107203 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:04.108641 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:04.118825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1006/1978] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:04 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:04.234585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d71c31-0145-488c-9946-6cc5a213c4e2 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:04.294758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d71c31-0145-488c-9946-6cc5a213c4e2 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:04.299598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:04.300460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:04.300743 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:04.301017 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] PATH_INFO: `/v3/users/0310642a7f6f46ea945bdde1e692ff7b` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:04.302205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0310642a7f6f46ea945bdde1e692ff7b)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:04.304186 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:04.433057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:04.434604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:04.445411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5526a-6db5-4d12-b27f-edae4d5e9d9a service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:04.449079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32167780-baed-401c-94f7-bbeec786ece0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:04.449710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167780-baed-401c-94f7-bbeec786ece0 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:04.449988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167780-baed-401c-94f7-bbeec786ece0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:04.450256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167780-baed-401c-94f7-bbeec786ece0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:04.452223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-32167780-baed-401c-94f7-bbeec786ece0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:04.518751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32167780-baed-401c-94f7-bbeec786ece0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:04.520282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32167780-baed-401c-94f7-bbeec786ece0 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:04.521586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0310642a7f6f46ea945bdde1e692ff7b'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:04.522247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0310642a7f6f46ea945bdde1e692ff7b'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:04.522908 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0310642a7f6f46ea945bdde1e692ff7b'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:04.535111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1007/1979] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:04 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:04.675936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0310642a7f6f46ea945bdde1e692ff7b'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:04.690815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0310642a7f6f46ea945bdde1e692ff7b'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:04.705067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 973/1980] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:04 2021] DELETE /identity/v3/users/0310642a7f6f46ea945bdde1e692ff7b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:04.710059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb577b-97db-47b5-8306-c50f85bc3a5d None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:04.710440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb577b-97db-47b5-8306-c50f85bc3a5d None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:04.710774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb577b-97db-47b5-8306-c50f85bc3a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:04.755794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-94eb577b-97db-47b5-8306-c50f85bc3a5d None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:04.758185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-94eb577b-97db-47b5-8306-c50f85bc3a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:04.768194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:04.769570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:04.868173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1008/1981] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:04.880200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb577b-97db-47b5-8306-c50f85bc3a5d None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:04.881812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-94eb577b-97db-47b5-8306-c50f85bc3a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:04.892161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aeb4dd-46ca-4542-b012-12ddac374501 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:04.899815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:04.901201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:04.901479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:04.902098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] PATH_INFO: `/v3/users/9afd59f7e16e40c3ac6990aa291b562d` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:04.903729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afd59f7e16e40c3ac6990aa291b562d)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:04.906164 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:04.969192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb577b-97db-47b5-8306-c50f85bc3a5d None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:04.973084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836157b-96c4-4097-a2b4-acb85f27ecbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:04.973775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836157b-96c4-4097-a2b4-acb85f27ecbf service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:04.974103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836157b-96c4-4097-a2b4-acb85f27ecbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:04.974385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836157b-96c4-4097-a2b4-acb85f27ecbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:04.991130 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836157b-96c4-4097-a2b4-acb85f27ecbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:04.992767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836157b-96c4-4097-a2b4-acb85f27ecbf service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:05.009625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1009/1982] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:05.179652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afd59f7e16e40c3ac6990aa291b562d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.181847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afd59f7e16e40c3ac6990aa291b562d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.182818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afd59f7e16e40c3ac6990aa291b562d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.270433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afd59f7e16e40c3ac6990aa291b562d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.283173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afd59f7e16e40c3ac6990aa291b562d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.295172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 974/1983] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:04 2021] DELETE /identity/v3/users/9afd59f7e16e40c3ac6990aa291b562d => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:05.299820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24882-f1d0-4bf5-a4c3-38540725c79b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:05.300327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24882-f1d0-4bf5-a4c3-38540725c79b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:05.300418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24882-f1d0-4bf5-a4c3-38540725c79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:05.320853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3fc24882-f1d0-4bf5-a4c3-38540725c79b None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:05.322664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3fc24882-f1d0-4bf5-a4c3-38540725c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:05.407207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1010/1984] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:05.414230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:05.416203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:05.487388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24882-f1d0-4bf5-a4c3-38540725c79b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:05.489835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3fc24882-f1d0-4bf5-a4c3-38540725c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:05.499806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065b91b-dc63-473e-b9ad-440648e9b1df admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:05.510630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24882-f1d0-4bf5-a4c3-38540725c79b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:05.512258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee583919-4566-4f7c-bb30-cdfe5c105569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:05.513704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583919-4566-4f7c-bb30-cdfe5c105569 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:05.514355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583919-4566-4f7c-bb30-cdfe5c105569 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:05.515065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583919-4566-4f7c-bb30-cdfe5c105569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:05.521454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:05.524154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:05.524849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:05.525593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] PATH_INFO: `/v3/projects/aa3cf3fdd8cc4c4681e569ad7521a2fe` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:05.530369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3cf3fdd8cc4c4681e569ad7521a2fe)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:05.534026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:05.535332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee583919-4566-4f7c-bb30-cdfe5c105569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:05.543030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee583919-4566-4f7c-bb30-cdfe5c105569 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:05.559408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 975/1985] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:05.796260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3cf3fdd8cc4c4681e569ad7521a2fe', 'request_id': 'req-c12cb12b-66fc-4ee4-902e-0d1f941b3259'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.944724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3cf3fdd8cc4c4681e569ad7521a2fe', 'request_id': 'req-c12cb12b-66fc-4ee4-902e-0d1f941b3259'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.950705 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3cf3fdd8cc4c4681e569ad7521a2fe', 'request_id': 'req-c12cb12b-66fc-4ee4-902e-0d1f941b3259'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.961808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] The token cache is being invalidate because project aa3cf3fdd8cc4c4681e569ad7521a2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:05.962643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.963302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:05.968807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1011/1986] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:05 2021] DELETE /identity/v3/projects/aa3cf3fdd8cc4c4681e569ad7521a2fe => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:05.970136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee583919-4566-4f7c-bb30-cdfe5c105569 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:05.982101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee583919-4566-4f7c-bb30-cdfe5c105569 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:06.036442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:06.037321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:06.037601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:06.037877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] PATH_INFO: `/v3/users/cbb211516c194878a376ba83f89da23e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:06.039117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb211516c194878a376ba83f89da23e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:06.041654 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:06.228310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:06.228310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:06.243578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb12b-66fc-4ee4-902e-0d1f941b3259 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:06.253063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:06.253975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:06.254232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:06.254510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] PATH_INFO: `/v3/projects/f1b538b628ba44919570f912fc220e51` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:06.262211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b538b628ba44919570f912fc220e51)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:06.262211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:06.305651 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb211516c194878a376ba83f89da23e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.306309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb211516c194878a376ba83f89da23e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.306941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb211516c194878a376ba83f89da23e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.448475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb211516c194878a376ba83f89da23e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.453602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b538b628ba44919570f912fc220e51', 'request_id': 'req-7f00ee43-2081-4df4-9721-96cc133881c7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.460913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb211516c194878a376ba83f89da23e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.473716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 976/1987] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:05 2021] DELETE /identity/v3/users/cbb211516c194878a376ba83f89da23e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:06.556482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b538b628ba44919570f912fc220e51', 'request_id': 'req-7f00ee43-2081-4df4-9721-96cc133881c7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.562309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b538b628ba44919570f912fc220e51', 'request_id': 'req-7f00ee43-2081-4df4-9721-96cc133881c7'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.575328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] The token cache is being invalidate because project f1b538b628ba44919570f912fc220e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:06.577953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.577953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.578471 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1012/1988] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:06 2021] DELETE /identity/v3/projects/f1b538b628ba44919570f912fc220e51 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:06.582686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:06.584116 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:06.648426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2d57-f3db-48a0-aa2c-43c2f6422531 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:06.653934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:06.654848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:06.655126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:06.655399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] PATH_INFO: `/v3/users/8e7f6ee57c01435eb4b631797b8f3a68` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:06.656599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7f6ee57c01435eb4b631797b8f3a68)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:06.658631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:06.848998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7f6ee57c01435eb4b631797b8f3a68'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.849665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7f6ee57c01435eb4b631797b8f3a68'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.850346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7f6ee57c01435eb4b631797b8f3a68'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.951600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:06.953007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:06.967383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7f6ee57c01435eb4b631797b8f3a68'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:06.997269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1d9e636d-092b-4f0b-99ae-7a5f4fde921f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7f6ee57c01435eb4b631797b8f3a68'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.016341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 977/1989] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:06 2021] DELETE /identity/v3/users/8e7f6ee57c01435eb4b631797b8f3a68 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:07.045440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00ee43-2081-4df4-9721-96cc133881c7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:07.117669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:07.119318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.119669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.120018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] PATH_INFO: `/v3/projects/f4d6d06bb99843b9abbd68f3d2730c48` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.121501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d6d06bb99843b9abbd68f3d2730c48)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:07.123665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:07.304005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d6d06bb99843b9abbd68f3d2730c48', 'request_id': 'req-9da2a941-2e3f-477b-9acb-10f5411db297'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.413155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d6d06bb99843b9abbd68f3d2730c48', 'request_id': 'req-9da2a941-2e3f-477b-9acb-10f5411db297'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.419719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d6d06bb99843b9abbd68f3d2730c48', 'request_id': 'req-9da2a941-2e3f-477b-9acb-10f5411db297'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.431025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] The token cache is being invalidate because project f4d6d06bb99843b9abbd68f3d2730c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:07.431398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.432165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9da2a941-2e3f-477b-9acb-10f5411db297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.433931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1013/1990] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:06 2021] DELETE /identity/v3/projects/f4d6d06bb99843b9abbd68f3d2730c48 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:07.439952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39360c9-3468-44c6-9b0d-fd068ac7d163 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.440240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39360c9-3468-44c6-9b0d-fd068ac7d163 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.440515 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39360c9-3468-44c6-9b0d-fd068ac7d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.457583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e39360c9-3468-44c6-9b0d-fd068ac7d163 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:07.458805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e39360c9-3468-44c6-9b0d-fd068ac7d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:07.517008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 978/1991] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:07.525475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e979d-4f1c-48bf-8151-aaef3ee9ca80 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.525932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e979d-4f1c-48bf-8151-aaef3ee9ca80 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.526081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e979d-4f1c-48bf-8151-aaef3ee9ca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.545147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-fe0e979d-4f1c-48bf-8151-aaef3ee9ca80 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:07.546331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-fe0e979d-4f1c-48bf-8151-aaef3ee9ca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:07.554912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1014/1992] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:07.561643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39360c9-3468-44c6-9b0d-fd068ac7d163 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:07.563032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e979d-4f1c-48bf-8151-aaef3ee9ca80 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:07.566943 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e39360c9-3468-44c6-9b0d-fd068ac7d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:07.572553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e979d-4f1c-48bf-8151-aaef3ee9ca80 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:07.577816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:07.578445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.578841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.579015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.579696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39360c9-3468-44c6-9b0d-fd068ac7d163 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:07.579802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:07.580033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:07.581837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:07.584854 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:07.585709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.586037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.586315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] PATH_INFO: `/v3/projects/bcf3824c7bcd4e2fb0a5e44e478e8034` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.593354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf3824c7bcd4e2fb0a5e44e478e8034)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:07.593354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:07.594253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1015/1993] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:07.598420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:07.608768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965121-ecb7-4509-8b24-75fbc5db740f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:07.613912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf89f-e1e9-46ba-9b92-298e29b40cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:07.614630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf89f-e1e9-46ba-9b92-298e29b40cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.614918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf89f-e1e9-46ba-9b92-298e29b40cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.615239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf89f-e1e9-46ba-9b92-298e29b40cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.615945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbf89f-e1e9-46ba-9b92-298e29b40cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:07.617842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbf89f-e1e9-46ba-9b92-298e29b40cf7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:07.726413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf3824c7bcd4e2fb0a5e44e478e8034', 'request_id': 'req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.746328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1016/1994] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:07 2021] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:07.750386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf89f-e1e9-46ba-9b92-298e29b40cf7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:07.795710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf3824c7bcd4e2fb0a5e44e478e8034', 'request_id': 'req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.801993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf3824c7bcd4e2fb0a5e44e478e8034', 'request_id': 'req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.810803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbf89f-e1e9-46ba-9b92-298e29b40cf7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:07.816015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:07.816259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] The token cache is being invalidate because project bcf3824c7bcd4e2fb0a5e44e478e8034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:07.816541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.816701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.817012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.817427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.817540 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:07.818141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:07.819496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 979/1995] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:07 2021] DELETE /identity/v3/projects/bcf3824c7bcd4e2fb0a5e44e478e8034 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:07.820265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:07.823209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:07.824834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:07.889937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e871-b620-4d3d-8ac5-7c1c13e75fee admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:07.894645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:07.895517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.895836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.896115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] PATH_INFO: `/v3/users/2164949241c74b06a9f1f07ba8de028f` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.897326 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2164949241c74b06a9f1f07ba8de028f)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:07.899266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:07.910470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1017/1996] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:07 2021] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:07.914393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:07.916743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:07.929954 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772c3f-177e-4ee0-9e2a-d02af5c7f471 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:07.936484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece357-8c94-4898-a3a4-5a83e6c009ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:07.937203 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece357-8c94-4898-a3a4-5a83e6c009ce admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.937483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece357-8c94-4898-a3a4-5a83e6c009ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.937752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece357-8c94-4898-a3a4-5a83e6c009ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.938572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ece357-8c94-4898-a3a4-5a83e6c009ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:07.940205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ece357-8c94-4898-a3a4-5a83e6c009ce admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:07.950298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1018/1997] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:07 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:07.955109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece357-8c94-4898-a3a4-5a83e6c009ce admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:07.965596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ece357-8c94-4898-a3a4-5a83e6c009ce admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:07.972050 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbeca9-516f-4213-aa49-cc9968d481ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:07.972704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbeca9-516f-4213-aa49-cc9968d481ca admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:07.972984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbeca9-516f-4213-aa49-cc9968d481ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:07.973254 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbeca9-516f-4213-aa49-cc9968d481ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:07.973981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbeca9-516f-4213-aa49-cc9968d481ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:07.975591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbeca9-516f-4213-aa49-cc9968d481ca admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:07.986497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1019/1998] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:07.990585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbeca9-516f-4213-aa49-cc9968d481ca admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:07.999791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbeca9-516f-4213-aa49-cc9968d481ca admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:08.004341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e8e11-e1d1-46f9-812e-a8bcdf3231df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:08.005265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8e11-e1d1-46f9-812e-a8bcdf3231df admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.005551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8e11-e1d1-46f9-812e-a8bcdf3231df admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.005821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8e11-e1d1-46f9-812e-a8bcdf3231df admin admin] PATH_INFO: `/v3/projects/a93dc2902b554bf496000dc24ae0d987/users/614d3e5456714a1eab930cb1944a3c04/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.020341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e8e11-e1d1-46f9-812e-a8bcdf3231df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93dc2902b554bf496000dc24ae0d987, user_id=614d3e5456714a1eab930cb1944a3c04, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:08.023067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e8e11-e1d1-46f9-812e-a8bcdf3231df admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:08.119982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2164949241c74b06a9f1f07ba8de028f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:08.120615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2164949241c74b06a9f1f07ba8de028f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:08.121392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2164949241c74b06a9f1f07ba8de028f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:08.121745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1020/1999] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:07 2021] PUT /identity/v3/projects/a93dc2902b554bf496000dc24ae0d987/users/614d3e5456714a1eab930cb1944a3c04/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:08.131842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075f79-c335-4213-a385-6bcaceeb2abc None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.132129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075f79-c335-4213-a385-6bcaceeb2abc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.132435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a075f79-c335-4213-a385-6bcaceeb2abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.158094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2a075f79-c335-4213-a385-6bcaceeb2abc None None] MFA Rules not processed for user `614d3e5456714a1eab930cb1944a3c04`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:08.159337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2a075f79-c335-4213-a385-6bcaceeb2abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:08.207257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2164949241c74b06a9f1f07ba8de028f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:08.219869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2164949241c74b06a9f1f07ba8de028f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:08.221111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1021/2000] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:08 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:08.225486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a075f79-c335-4213-a385-6bcaceeb2abc None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:08.226826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2a075f79-c335-4213-a385-6bcaceeb2abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:08.232997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 980/2001] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:07 2021] DELETE /identity/v3/users/2164949241c74b06a9f1f07ba8de028f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:08.300842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a075f79-c335-4213-a385-6bcaceeb2abc None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:08.360348 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a96ae-24f8-4204-8450-664e36cff95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:08.361046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a96ae-24f8-4204-8450-664e36cff95a admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.361333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a96ae-24f8-4204-8450-664e36cff95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.361612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a96ae-24f8-4204-8450-664e36cff95a admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.362323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a96ae-24f8-4204-8450-664e36cff95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:08.364274 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a96ae-24f8-4204-8450-664e36cff95a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:08.471291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1022/2002] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:08 2021] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:08.475299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:08.485720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112dec1-4d65-4634-9c6a-ba1e5f2fa42f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:08.542114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2d49e-d096-4c30-82ce-e86b609b3c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:08.543042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2d49e-d096-4c30-82ce-e86b609b3c6b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.543326 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2d49e-d096-4c30-82ce-e86b609b3c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.543789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2d49e-d096-4c30-82ce-e86b609b3c6b admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.545115 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2d49e-d096-4c30-82ce-e86b609b3c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:08.548148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2d49e-d096-4c30-82ce-e86b609b3c6b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:08.636264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 981/2003] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:08 2021] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:08.640252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a96ae-24f8-4204-8450-664e36cff95a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:08.651155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a96ae-24f8-4204-8450-664e36cff95a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:08.656292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:08.657033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.657402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.657744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.658609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:08.660271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:08.670832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1023/2004] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:08.675074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2d49e-d096-4c30-82ce-e86b609b3c6b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:08.685353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2d49e-d096-4c30-82ce-e86b609b3c6b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:08.689955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4132923-2bf5-41a3-8f32-1d87035ae5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:08.690893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132923-2bf5-41a3-8f32-1d87035ae5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.691198 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132923-2bf5-41a3-8f32-1d87035ae5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.691489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4132923-2bf5-41a3-8f32-1d87035ae5bd admin admin] PATH_INFO: `/v3/projects/2af6c86fb64d47f386bb55dff766769c/users/3641b4f1fea3409e8357d0e660b6e50f/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.706297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4132923-2bf5-41a3-8f32-1d87035ae5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af6c86fb64d47f386bb55dff766769c, user_id=3641b4f1fea3409e8357d0e660b6e50f, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:08.708989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4132923-2bf5-41a3-8f32-1d87035ae5bd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:08.757427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:08.759767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:08.773671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7b258-3222-45e5-8e3e-8d2a83d0535d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:08.783095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 982/2005] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:08 2021] PUT /identity/v3/projects/2af6c86fb64d47f386bb55dff766769c/users/3641b4f1fea3409e8357d0e660b6e50f/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:08.787356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4132923-2bf5-41a3-8f32-1d87035ae5bd admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:08.830667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:08.831541 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.831826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.832105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] PATH_INFO: `/v3/projects/200abce4abbe41ad9945f9303cec8910` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.833312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=200abce4abbe41ad9945f9303cec8910)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:08.835265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:08.846430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4132923-2bf5-41a3-8f32-1d87035ae5bd admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:08.851059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9bc5b-c661-4589-9e89-3057c789f7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:08.851716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9bc5b-c661-4589-9e89-3057c789f7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.851995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9bc5b-c661-4589-9e89-3057c789f7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.852268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9bc5b-c661-4589-9e89-3057c789f7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.853031 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9bc5b-c661-4589-9e89-3057c789f7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:08.854893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9bc5b-c661-4589-9e89-3057c789f7e2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:08.864513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 983/2006] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:08 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:08.873072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9bc5b-c661-4589-9e89-3057c789f7e2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:08.879311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9bc5b-c661-4589-9e89-3057c789f7e2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:08.885067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ea1bf-49ff-432f-8467-b66703003162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:08.885995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea1bf-49ff-432f-8467-b66703003162 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.886402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea1bf-49ff-432f-8467-b66703003162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.886803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea1bf-49ff-432f-8467-b66703003162 admin admin] PATH_INFO: `/v3/projects/2af6c86fb64d47f386bb55dff766769c/users/3641b4f1fea3409e8357d0e660b6e50f/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.888944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ea1bf-49ff-432f-8467-b66703003162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af6c86fb64d47f386bb55dff766769c, user_id=3641b4f1fea3409e8357d0e660b6e50f, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:08.891674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ea1bf-49ff-432f-8467-b66703003162 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:08.902149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 984/2007] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:08 2021] PUT /identity/v3/projects/2af6c86fb64d47f386bb55dff766769c/users/3641b4f1fea3409e8357d0e660b6e50f/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:08.913342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4c9e7-840f-4dad-b970-e608075d3d65 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:08.913629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4c9e7-840f-4dad-b970-e608075d3d65 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:08.913898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4c9e7-840f-4dad-b970-e608075d3d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:08.942358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-89c4c9e7-840f-4dad-b970-e608075d3d65 None None] MFA Rules not processed for user `3641b4f1fea3409e8357d0e660b6e50f`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:08.943010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200abce4abbe41ad9945f9303cec8910', 'request_id': 'req-9152f127-6f8f-4fba-bddf-cce707be6b9a'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:08.943605 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-89c4c9e7-840f-4dad-b970-e608075d3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:09.007111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200abce4abbe41ad9945f9303cec8910', 'request_id': 'req-9152f127-6f8f-4fba-bddf-cce707be6b9a'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:09.014033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 985/2008] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:08 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:09.014187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200abce4abbe41ad9945f9303cec8910', 'request_id': 'req-9152f127-6f8f-4fba-bddf-cce707be6b9a'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:09.025456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4c9e7-840f-4dad-b970-e608075d3d65 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:09.026301 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] The token cache is being invalidate because project 200abce4abbe41ad9945f9303cec8910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:09.026878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-89c4c9e7-840f-4dad-b970-e608075d3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:09.027012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:09.027635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9152f127-6f8f-4fba-bddf-cce707be6b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:09.034385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1024/2009] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:08 2021] DELETE /identity/v3/projects/200abce4abbe41ad9945f9303cec8910 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:09.036149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7da5-981d-42c0-859f-cd59948f45e2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.036439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7da5-981d-42c0-859f-cd59948f45e2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.036736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7da5-981d-42c0-859f-cd59948f45e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.057167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-12cf7da5-981d-42c0-859f-cd59948f45e2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:09.058588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-12cf7da5-981d-42c0-859f-cd59948f45e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:09.088199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4c9e7-840f-4dad-b970-e608075d3d65 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:09.092285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e50d0-70ce-4c64-97e9-de3fdf6039ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:09.092580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e50d0-70ce-4c64-97e9-de3fdf6039ea service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.092863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e50d0-70ce-4c64-97e9-de3fdf6039ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.093140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e50d0-70ce-4c64-97e9-de3fdf6039ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.095067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d19e50d0-70ce-4c64-97e9-de3fdf6039ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:09.107989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e50d0-70ce-4c64-97e9-de3fdf6039ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:09.109500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e50d0-70ce-4c64-97e9-de3fdf6039ea service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:09.120229 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 986/2010] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:09 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:09.127369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1025/2011] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:09.137185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52494b71-d6b8-4028-8c91-a2ca1a5a8f89 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.137453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52494b71-d6b8-4028-8c91-a2ca1a5a8f89 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.137732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52494b71-d6b8-4028-8c91-a2ca1a5a8f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.163084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-52494b71-d6b8-4028-8c91-a2ca1a5a8f89 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:09.164532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-52494b71-d6b8-4028-8c91-a2ca1a5a8f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:09.180921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 987/2012] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:09.185133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7da5-981d-42c0-859f-cd59948f45e2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:09.194676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7da5-981d-42c0-859f-cd59948f45e2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:09.199900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:09.200572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.200824 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.201079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.201810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:09.202117 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:09.203733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:09.217222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1026/2013] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:09.222656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52494b71-d6b8-4028-8c91-a2ca1a5a8f89 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:09.232362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52494b71-d6b8-4028-8c91-a2ca1a5a8f89 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:09.237499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1d7fd-60c2-4d88-9b64-91ac6aafe7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:09.238350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1d7fd-60c2-4d88-9b64-91ac6aafe7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.238665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1d7fd-60c2-4d88-9b64-91ac6aafe7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.239029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1d7fd-60c2-4d88-9b64-91ac6aafe7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.240230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1d7fd-60c2-4d88-9b64-91ac6aafe7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:09.243432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1d7fd-60c2-4d88-9b64-91ac6aafe7f6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:09.357792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 988/2014] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:09 2021] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:09.362250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:09.372188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f0f6-ed5f-438f-88b9-83f85203735e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:09.432101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609003e-6a62-4aab-9f98-3c8788813ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:09.432795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609003e-6a62-4aab-9f98-3c8788813ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.433156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609003e-6a62-4aab-9f98-3c8788813ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.433326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609003e-6a62-4aab-9f98-3c8788813ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.434260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609003e-6a62-4aab-9f98-3c8788813ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:09.436238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609003e-6a62-4aab-9f98-3c8788813ca6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:09.560059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1027/2015] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:09 2021] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:09.561223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1d7fd-60c2-4d88-9b64-91ac6aafe7f6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:09.572866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1d7fd-60c2-4d88-9b64-91ac6aafe7f6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:09.577599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03aa84-9e86-4565-b3cd-712b7146f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:09.578277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03aa84-9e86-4565-b3cd-712b7146f8de admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.578597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03aa84-9e86-4565-b3cd-712b7146f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.578860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03aa84-9e86-4565-b3cd-712b7146f8de admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.579599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03aa84-9e86-4565-b3cd-712b7146f8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:09.581427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03aa84-9e86-4565-b3cd-712b7146f8de admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:09.596202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 989/2016] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:09 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:09.602790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609003e-6a62-4aab-9f98-3c8788813ca6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:09.614294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609003e-6a62-4aab-9f98-3c8788813ca6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:09.619753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a593a6-efd1-4c8a-972d-ac730a951b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:09.620440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a593a6-efd1-4c8a-972d-ac730a951b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.620723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a593a6-efd1-4c8a-972d-ac730a951b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.620996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a593a6-efd1-4c8a-972d-ac730a951b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.621735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a593a6-efd1-4c8a-972d-ac730a951b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:09.623391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a593a6-efd1-4c8a-972d-ac730a951b16 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:09.636645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1028/2017] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:09.642062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03aa84-9e86-4565-b3cd-712b7146f8de admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:09.652146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03aa84-9e86-4565-b3cd-712b7146f8de admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:09.656659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90825044-685f-4e37-8839-00e4940bcc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:09.657527 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90825044-685f-4e37-8839-00e4940bcc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.657806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90825044-685f-4e37-8839-00e4940bcc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.658078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90825044-685f-4e37-8839-00e4940bcc0d admin admin] PATH_INFO: `/v3/projects/6212cf4db71a4c42b0e47a46686bf4f7/users/ccc9a35d5326452ca3cdbd6a199f3670/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.673587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90825044-685f-4e37-8839-00e4940bcc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6212cf4db71a4c42b0e47a46686bf4f7, user_id=ccc9a35d5326452ca3cdbd6a199f3670, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:09.676297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90825044-685f-4e37-8839-00e4940bcc0d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:09.819032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 990/2018] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:09 2021] PUT /identity/v3/projects/6212cf4db71a4c42b0e47a46686bf4f7/users/ccc9a35d5326452ca3cdbd6a199f3670/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:09.830974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9bff4-102b-480c-87b7-2b874b75b670 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:09.831446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9bff4-102b-480c-87b7-2b874b75b670 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:09.831536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9bff4-102b-480c-87b7-2b874b75b670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:09.858504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-31a9bff4-102b-480c-87b7-2b874b75b670 None None] MFA Rules not processed for user `ccc9a35d5326452ca3cdbd6a199f3670`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:09.859753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-31a9bff4-102b-480c-87b7-2b874b75b670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:09.922703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1029/2019] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:09 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:09.927281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90825044-685f-4e37-8839-00e4940bcc0d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:09.994170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90825044-685f-4e37-8839-00e4940bcc0d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:09.999283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fcfbc-b6ee-4719-b305-c7e1835039a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.000074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fcfbc-b6ee-4719-b305-c7e1835039a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.000387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fcfbc-b6ee-4719-b305-c7e1835039a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.000645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fcfbc-b6ee-4719-b305-c7e1835039a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.001343 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fcfbc-b6ee-4719-b305-c7e1835039a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.003274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fcfbc-b6ee-4719-b305-c7e1835039a3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.123301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 991/2020] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:09 2021] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:10.127451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9bff4-102b-480c-87b7-2b874b75b670 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.138232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9bff4-102b-480c-87b7-2b874b75b670 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.204234 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b31c5-a973-4bad-8216-d8ca17185659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.204917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b31c5-a973-4bad-8216-d8ca17185659 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.205338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b31c5-a973-4bad-8216-d8ca17185659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.205788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b31c5-a973-4bad-8216-d8ca17185659 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.206378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b31c5-a973-4bad-8216-d8ca17185659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.208387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b31c5-a973-4bad-8216-d8ca17185659 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.306264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fcfbc-b6ee-4719-b305-c7e1835039a3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.306490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1030/2021] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:10 2021] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:10.313904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b31c5-a973-4bad-8216-d8ca17185659 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.331005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b31c5-a973-4bad-8216-d8ca17185659 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.344511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1a99b-ad1f-446c-9d5b-4cd5e29363a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.345188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a99b-ad1f-446c-9d5b-4cd5e29363a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.345488 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a99b-ad1f-446c-9d5b-4cd5e29363a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.349302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1a99b-ad1f-446c-9d5b-4cd5e29363a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.353300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1a99b-ad1f-446c-9d5b-4cd5e29363a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.353990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1a99b-ad1f-446c-9d5b-4cd5e29363a3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.365016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1031/2022] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:10 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:10.371128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1a99b-ad1f-446c-9d5b-4cd5e29363a3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.381272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1a99b-ad1f-446c-9d5b-4cd5e29363a3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.388837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d142f-2c6b-4897-82f0-71478000c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.393016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d142f-2c6b-4897-82f0-71478000c002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.393449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d142f-2c6b-4897-82f0-71478000c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.393869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d142f-2c6b-4897-82f0-71478000c002 admin admin] PATH_INFO: `/v3/projects/9cedd31d960d4572bbae4219521823ba/users/6283294471aa45a6b64a39622d2827d9/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.396469 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fcfbc-b6ee-4719-b305-c7e1835039a3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.402938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3641b4f1fea3409e8357d0e660b6e50f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2af6c86fb64d47f386bb55dff766769c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.403624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.403915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.404196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.405096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:10.405941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.407688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.416782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d142f-2c6b-4897-82f0-71478000c002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cedd31d960d4572bbae4219521823ba, user_id=6283294471aa45a6b64a39622d2827d9, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.420253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d142f-2c6b-4897-82f0-71478000c002 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.439639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 992/2023] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:10.440738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.455550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a00d0-64e4-4523-9764-bd73c48fa10c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.460762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e14b68-ba91-4327-a4f0-0e4650263746 tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3641b4f1fea3409e8357d0e660b6e50f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2af6c86fb64d47f386bb55dff766769c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.461500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14b68-ba91-4327-a4f0-0e4650263746 tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.462626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14b68-ba91-4327-a4f0-0e4650263746 tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.462764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14b68-ba91-4327-a4f0-0e4650263746 tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.463799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e14b68-ba91-4327-a4f0-0e4650263746 tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.466322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e14b68-ba91-4327-a4f0-0e4650263746 tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.543726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1032/2024] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:10 2021] PUT /identity/v3/projects/9cedd31d960d4572bbae4219521823ba/users/6283294471aa45a6b64a39622d2827d9/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:10.544186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d142f-2c6b-4897-82f0-71478000c002 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.598584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 993/2025] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:10 2021] POST /identity/v3/projects => generated 352 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:10.603793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e14b68-ba91-4327-a4f0-0e4650263746 tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.630979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d142f-2c6b-4897-82f0-71478000c002 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.680046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e14b68-ba91-4327-a4f0-0e4650263746 tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.685891 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3641b4f1fea3409e8357d0e660b6e50f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2af6c86fb64d47f386bb55dff766769c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.686588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.686868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.687143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.687879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:10.688181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.690589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.705742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 994/2026] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:10.714872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dca94-de8f-4db5-aa82-ee5080d7e6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.715616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dca94-de8f-4db5-aa82-ee5080d7e6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.716036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dca94-de8f-4db5-aa82-ee5080d7e6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.716336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dca94-de8f-4db5-aa82-ee5080d7e6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.717253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dca94-de8f-4db5-aa82-ee5080d7e6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.719257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808dca94-de8f-4db5-aa82-ee5080d7e6b6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.742359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1033/2027] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:10 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:10.746862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.758488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011e3df-e38f-4194-b9bd-56c014045e6c tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.766246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b5c0-0ce5-4d5d-9e91-f14700f096ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.766246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b5c0-0ce5-4d5d-9e91-f14700f096ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.766246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b5c0-0ce5-4d5d-9e91-f14700f096ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.766246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b5c0-0ce5-4d5d-9e91-f14700f096ad admin admin] PATH_INFO: `/v3/projects/9cedd31d960d4572bbae4219521823ba/users/6283294471aa45a6b64a39622d2827d9/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.768784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422b5c0-0ce5-4d5d-9e91-f14700f096ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cedd31d960d4572bbae4219521823ba, user_id=6283294471aa45a6b64a39622d2827d9, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.772016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422b5c0-0ce5-4d5d-9e91-f14700f096ad admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.795588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 995/2028] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:10 2021] PUT /identity/v3/projects/9cedd31d960d4572bbae4219521823ba/users/6283294471aa45a6b64a39622d2827d9/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:10.797210 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34225c5-9c61-4f7b-b3b5-1dd7a94de2a3 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.797504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34225c5-9c61-4f7b-b3b5-1dd7a94de2a3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.797784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34225c5-9c61-4f7b-b3b5-1dd7a94de2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.813575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b5c0-0ce5-4d5d-9e91-f14700f096ad admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.852132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-d34225c5-9c61-4f7b-b3b5-1dd7a94de2a3 None None] MFA Rules not processed for user `6283294471aa45a6b64a39622d2827d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:10.854002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d34225c5-9c61-4f7b-b3b5-1dd7a94de2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:10.912831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b5c0-0ce5-4d5d-9e91-f14700f096ad admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:10.920073 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3641b4f1fea3409e8357d0e660b6e50f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2af6c86fb64d47f386bb55dff766769c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:10.921094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:10.922128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:10.922478 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] PATH_INFO: `/v3/projects/5aba104d5a7a4726b25ca74bd2973f94` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:10.924167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5aba104d5a7a4726b25ca74bd2973f94)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:10.926187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:10.953733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1034/2029] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:10 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:10.965509 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34225c5-9c61-4f7b-b3b5-1dd7a94de2a3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:10.966868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d34225c5-9c61-4f7b-b3b5-1dd7a94de2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:11.078084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aba104d5a7a4726b25ca74bd2973f94', 'request_id': 'req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:11.082620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34225c5-9c61-4f7b-b3b5-1dd7a94de2a3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:11.146306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:11.146306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:11.146306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:11.146306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:11.167606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aba104d5a7a4726b25ca74bd2973f94', 'request_id': 'req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:11.186480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aba104d5a7a4726b25ca74bd2973f94', 'request_id': 'req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:11.193313 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] The token cache is being invalidate because project 5aba104d5a7a4726b25ca74bd2973f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:11.193862 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:11.194753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:11.197375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 996/2030] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:10 2021] DELETE /identity/v3/projects/5aba104d5a7a4726b25ca74bd2973f94 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:11.213938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:11.221082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:11.235047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1035/2031] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:10 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:11.910103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:11.911774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:11.925574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d58438-5bf5-4e34-8baf-c8f9f6adca7f tempest-VolumeQuotaClassesTest-1500616173 tempest-VolumeQuotaClassesTest-1500616173-project-admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:11.945098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f6b5f-9526-409d-9f3c-2a1a8c2b04b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:11.945800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6b5f-9526-409d-9f3c-2a1a8c2b04b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:11.947184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6b5f-9526-409d-9f3c-2a1a8c2b04b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:11.947492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f6b5f-9526-409d-9f3c-2a1a8c2b04b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:11.949657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-168f6b5f-9526-409d-9f3c-2a1a8c2b04b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:12.022497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f6b5f-9526-409d-9f3c-2a1a8c2b04b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:12.025884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f6b5f-9526-409d-9f3c-2a1a8c2b04b5 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:12.040844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 997/2032] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:11 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:12.921288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:12.922716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:12.999333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd303f-4c4d-40ac-81c7-22d4d97d0620 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:13.004115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:13.005004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:13.017752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:13.017752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] PATH_INFO: `/v3/users/614d3e5456714a1eab930cb1944a3c04` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:13.017752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=614d3e5456714a1eab930cb1944a3c04)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:13.017752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:13.306956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614d3e5456714a1eab930cb1944a3c04'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:13.307602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614d3e5456714a1eab930cb1944a3c04'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:13.308201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614d3e5456714a1eab930cb1944a3c04'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:13.412852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614d3e5456714a1eab930cb1944a3c04'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:13.425510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614d3e5456714a1eab930cb1944a3c04'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:13.437277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1036/2033] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:12 2021] DELETE /identity/v3/users/614d3e5456714a1eab930cb1944a3c04 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:13.441938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d9c0-86c4-4599-87ea-2d975eb99521 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:13.442394 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d9c0-86c4-4599-87ea-2d975eb99521 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:13.442482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d9c0-86c4-4599-87ea-2d975eb99521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:13.458992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a975d9c0-86c4-4599-87ea-2d975eb99521 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:13.460185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a975d9c0-86c4-4599-87ea-2d975eb99521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:13.517985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 998/2034] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:13.530489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:13.532219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:13.599860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b394eed-d574-4842-8e37-6d49d629edaa admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:13.605379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d35bd-0986-405f-8be6-a5e8d695c1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:13.606089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d35bd-0986-405f-8be6-a5e8d695c1ad service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:13.606481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d35bd-0986-405f-8be6-a5e8d695c1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:13.606690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d35bd-0986-405f-8be6-a5e8d695c1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:13.616671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d35bd-0986-405f-8be6-a5e8d695c1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:13.618964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d35bd-0986-405f-8be6-a5e8d695c1ad service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:13.629505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1037/2035] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:14.164097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975d9c0-86c4-4599-87ea-2d975eb99521 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:14.165779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a975d9c0-86c4-4599-87ea-2d975eb99521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:14.187255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975d9c0-86c4-4599-87ea-2d975eb99521 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:14.199779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:14.199779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:14.199779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:14.199779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] PATH_INFO: `/v3/projects/a93dc2902b554bf496000dc24ae0d987` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:14.200144 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93dc2902b554bf496000dc24ae0d987)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:14.200738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:14.371549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93dc2902b554bf496000dc24ae0d987', 'request_id': 'req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.528276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93dc2902b554bf496000dc24ae0d987', 'request_id': 'req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.535387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93dc2902b554bf496000dc24ae0d987', 'request_id': 'req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.548729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] The token cache is being invalidate because project a93dc2902b554bf496000dc24ae0d987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:14.549006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.549709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.551410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 999/2036] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:14 2021] DELETE /identity/v3/projects/a93dc2902b554bf496000dc24ae0d987 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:14.555423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d35bd-0986-405f-8be6-a5e8d695c1ad service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:14.565577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d35bd-0986-405f-8be6-a5e8d695c1ad service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:14.626810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:14.633750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:14.633750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:14.633750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] PATH_INFO: `/v3/users/3641b4f1fea3409e8357d0e660b6e50f` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:14.633750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3641b4f1fea3409e8357d0e660b6e50f)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:14.633750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:14.850837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3641b4f1fea3409e8357d0e660b6e50f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.851515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3641b4f1fea3409e8357d0e660b6e50f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.852158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3641b4f1fea3409e8357d0e660b6e50f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.933464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3641b4f1fea3409e8357d0e660b6e50f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.946074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e3d621c5-45b7-49cb-8f34-d50e2f9e56c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3641b4f1fea3409e8357d0e660b6e50f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:14.959071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1038/2037] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:14 2021] DELETE /identity/v3/users/3641b4f1fea3409e8357d0e660b6e50f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:15.415525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:15.417785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:15.433104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073407b-5f59-4be1-bd89-ef6f26b8d4c6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:15.504611 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:15.505631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:15.506024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:15.506341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] PATH_INFO: `/v3/projects/2af6c86fb64d47f386bb55dff766769c` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:15.507749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af6c86fb64d47f386bb55dff766769c)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:15.509801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:15.620585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af6c86fb64d47f386bb55dff766769c', 'request_id': 'req-6084a2ad-88f8-4390-853c-f343c02ed78c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:15.721698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af6c86fb64d47f386bb55dff766769c', 'request_id': 'req-6084a2ad-88f8-4390-853c-f343c02ed78c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:15.728098 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af6c86fb64d47f386bb55dff766769c', 'request_id': 'req-6084a2ad-88f8-4390-853c-f343c02ed78c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:15.746504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] The token cache is being invalidate because project 2af6c86fb64d47f386bb55dff766769c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:15.747046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:15.747705 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6084a2ad-88f8-4390-853c-f343c02ed78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:15.749322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1000/2038] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:15 2021] DELETE /identity/v3/projects/2af6c86fb64d47f386bb55dff766769c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:15.755239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1c051-65fc-4432-b0f1-1d9ae975479b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:15.759252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1c051-65fc-4432-b0f1-1d9ae975479b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:15.759252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1c051-65fc-4432-b0f1-1d9ae975479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:15.774757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-d7b1c051-65fc-4432-b0f1-1d9ae975479b None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:15.777628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d7b1c051-65fc-4432-b0f1-1d9ae975479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:15.854796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1039/2039] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:15.856609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70fa0-b153-4eee-9dda-43aa0cf2acd7 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:15.857088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70fa0-b153-4eee-9dda-43aa0cf2acd7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:15.857501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70fa0-b153-4eee-9dda-43aa0cf2acd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:15.892202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9ad70fa0-b153-4eee-9dda-43aa0cf2acd7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:15.893429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9ad70fa0-b153-4eee-9dda-43aa0cf2acd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:15.903067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1001/2040] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:15.906933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1c051-65fc-4432-b0f1-1d9ae975479b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:15.918959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1c051-65fc-4432-b0f1-1d9ae975479b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:15.921392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:15.921783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:15.923485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:15.923485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:15.923485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:15.923485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:15.925508 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:15.938574 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1040/2041] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:15.942207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70fa0-b153-4eee-9dda-43aa0cf2acd7 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:15.964859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70fa0-b153-4eee-9dda-43aa0cf2acd7 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:15.970068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:15.971019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:15.979920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:15.979920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:15.979920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:15.979920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:16.080189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1002/2042] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:15 2021] POST /identity/v3/projects => generated 407 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:16.082165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:16.092138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723f91-b792-4ecd-85f9-46dee210fe96 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:16.111835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:16.113556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:16.161977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:16.165637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:16.165637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:16.165637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:16.165637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:16.166108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:16.184812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ecd4f-af43-49b2-8a68-91c399a569d3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:16.189485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:16.190375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:16.190751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:16.191024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] PATH_INFO: `/v3/users/fd27fcaf54b54d80971beadb9b14d1e7` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:16.193333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd27fcaf54b54d80971beadb9b14d1e7)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:16.202211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:16.256822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1041/2043] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:16 2021] POST /identity/v3/users => generated 304 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:16.256822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:16.257475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:16.271343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa38e2-2506-4c2a-a8b4-242f48100803 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:16.276545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:16.277412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:16.277689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:16.279300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] PATH_INFO: `/v3/users/4fc8f96ac70b482dade4022f7f05815f` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:16.279300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc8f96ac70b482dade4022f7f05815f)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:16.281219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:16.415597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd27fcaf54b54d80971beadb9b14d1e7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.416233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd27fcaf54b54d80971beadb9b14d1e7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.417426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd27fcaf54b54d80971beadb9b14d1e7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.516643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc8f96ac70b482dade4022f7f05815f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.517284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc8f96ac70b482dade4022f7f05815f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.517870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc8f96ac70b482dade4022f7f05815f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.527172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd27fcaf54b54d80971beadb9b14d1e7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.540975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd27fcaf54b54d80971beadb9b14d1e7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.562391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1003/2044] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:16 2021] DELETE /identity/v3/users/fd27fcaf54b54d80971beadb9b14d1e7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:16.562391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:16.562391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:16.606745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc8f96ac70b482dade4022f7f05815f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.620976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-326dbbbd-1c9e-4b30-a454-91a3f6c2396f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc8f96ac70b482dade4022f7f05815f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:16.635671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1042/2045] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:16 2021] DELETE /identity/v3/users/4fc8f96ac70b482dade4022f7f05815f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:16.641798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2161-5da9-4c7e-be65-918b248ce5f6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:16.648192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b721-2d2c-4616-ba03-f1ceeee7d3d7 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:16.648497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b721-2d2c-4616-ba03-f1ceeee7d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:16.649526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b721-2d2c-4616-ba03-f1ceeee7d3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:16.670780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4b25b721-2d2c-4616-ba03-f1ceeee7d3d7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:16.672115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4b25b721-2d2c-4616-ba03-f1ceeee7d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:16.713156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:16.713926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:16.714204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:16.714572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:16.715628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:16.717930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:16.732941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1004/2046] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:16 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:16.733917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:16.742018 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:16.786120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e8dfd-2d94-4234-ba91-4fb69e48ec10 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:16.805064 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948f6f9-d374-4c64-8694-2df6d22589e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:16.805773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948f6f9-d374-4c64-8694-2df6d22589e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:16.806052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948f6f9-d374-4c64-8694-2df6d22589e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:16.806333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948f6f9-d374-4c64-8694-2df6d22589e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:16.807758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948f6f9-d374-4c64-8694-2df6d22589e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:16.809494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948f6f9-d374-4c64-8694-2df6d22589e8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:16.826441 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1005/2047] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:16 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:16.831595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948f6f9-d374-4c64-8694-2df6d22589e8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:16.846873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948f6f9-d374-4c64-8694-2df6d22589e8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:16.856662 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:16.857598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:16.857939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:16.858224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] PATH_INFO: `/v3/projects/e371a68de0414ffda6dd74bcbe6b8d09/users/67ef27051301416f8654d31205fe78ec/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:16.877245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e371a68de0414ffda6dd74bcbe6b8d09, user_id=67ef27051301416f8654d31205fe78ec, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:16.880580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:16.923567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1043/2048] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:16.933775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b721-2d2c-4616-ba03-f1ceeee7d3d7 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:16.942351 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4b25b721-2d2c-4616-ba03-f1ceeee7d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:16.994212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b721-2d2c-4616-ba03-f1ceeee7d3d7 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:16.998773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b78ad-b3ed-4b1d-88aa-f99997a87510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:16.999491 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b78ad-b3ed-4b1d-88aa-f99997a87510 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:16.999816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b78ad-b3ed-4b1d-88aa-f99997a87510 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.000044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b78ad-b3ed-4b1d-88aa-f99997a87510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.010109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b78ad-b3ed-4b1d-88aa-f99997a87510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.012203 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b78ad-b3ed-4b1d-88aa-f99997a87510 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.026358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1006/2049] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:16 2021] PUT /identity/v3/projects/e371a68de0414ffda6dd74bcbe6b8d09/users/67ef27051301416f8654d31205fe78ec/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:17.027109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1044/2050] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:17.027232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.031425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.040671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ed24-e807-47a8-b28d-5532906393f0 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.041288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ed24-e807-47a8-b28d-5532906393f0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.041765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ed24-e807-47a8-b28d-5532906393f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.083528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7674ed24-e807-47a8-b28d-5532906393f0 None None] MFA Rules not processed for user `67ef27051301416f8654d31205fe78ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:17.085122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7674ed24-e807-47a8-b28d-5532906393f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.117641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977085b-4e10-4008-b0d5-90717d5d4c5d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.124067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.125235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.125235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.125544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] PATH_INFO: `/v3/projects/cceb60931e5541518c468df87510c262` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.126818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cceb60931e5541518c468df87510c262)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.129236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.161239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1045/2051] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:17 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:17.162356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ed24-e807-47a8-b28d-5532906393f0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.172753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ed24-e807-47a8-b28d-5532906393f0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.177295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c285430-7541-42b8-a216-5014f0bcb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.177927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285430-7541-42b8-a216-5014f0bcb509 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.178205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285430-7541-42b8-a216-5014f0bcb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.178476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c285430-7541-42b8-a216-5014f0bcb509 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.179207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c285430-7541-42b8-a216-5014f0bcb509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.181131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c285430-7541-42b8-a216-5014f0bcb509 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.268996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cceb60931e5541518c468df87510c262', 'request_id': 'req-551f2d18-6012-4a23-a2dc-68ffa5461fd2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.284733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1046/2052] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:17 2021] POST /identity/v3/projects => generated 409 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:17.289744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c285430-7541-42b8-a216-5014f0bcb509 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.360563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c285430-7541-42b8-a216-5014f0bcb509 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.365283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.365947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.366231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.366503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.367261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.369160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.384207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cceb60931e5541518c468df87510c262', 'request_id': 'req-551f2d18-6012-4a23-a2dc-68ffa5461fd2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.390784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cceb60931e5541518c468df87510c262', 'request_id': 'req-551f2d18-6012-4a23-a2dc-68ffa5461fd2'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.407550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] The token cache is being invalidate because project cceb60931e5541518c468df87510c262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:17.407954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.408682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-551f2d18-6012-4a23-a2dc-68ffa5461fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.410876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1007/2053] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:17 2021] DELETE /identity/v3/projects/cceb60931e5541518c468df87510c262 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:17.416930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d869ee-2876-4df1-bc3f-fcb3c4b42b51 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.417264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d869ee-2876-4df1-bc3f-fcb3c4b42b51 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.417638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d869ee-2876-4df1-bc3f-fcb3c4b42b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.435878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-18d869ee-2876-4df1-bc3f-fcb3c4b42b51 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:17.437156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-18d869ee-2876-4df1-bc3f-fcb3c4b42b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.445117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1008/2054] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:17.454796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd01596-ea2c-4118-b2a7-97c4dc635288 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.454796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd01596-ea2c-4118-b2a7-97c4dc635288 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.454796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd01596-ea2c-4118-b2a7-97c4dc635288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.470802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5dd01596-ea2c-4118-b2a7-97c4dc635288 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:17.471976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5dd01596-ea2c-4118-b2a7-97c4dc635288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.480445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1009/2055] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:17.484524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd01596-ea2c-4118-b2a7-97c4dc635288 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.497195 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd01596-ea2c-4118-b2a7-97c4dc635288 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.497354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1047/2056] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:17 2021] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:17.501102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.501814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.502801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.502941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.503082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.503354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.504096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:17.504380 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.507804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.516614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758f4f0-dc96-4fec-b0c1-5d026aa02e5f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.525851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1010/2057] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:15:17.525851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.527811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.528710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.529932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.530361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.531464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.533562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.537929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5dc12-760e-4716-a9ad-f7323f76c4cc admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.544591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ecb96-7004-4ec4-a300-13572d9fe469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.545827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ecb96-7004-4ec4-a300-13572d9fe469 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.546183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ecb96-7004-4ec4-a300-13572d9fe469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.546536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ecb96-7004-4ec4-a300-13572d9fe469 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.547346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ecb96-7004-4ec4-a300-13572d9fe469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.549924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ecb96-7004-4ec4-a300-13572d9fe469 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.563151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1048/2058] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:17 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:17.564235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.565939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.578768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e006-db1a-4c03-9257-9ebdf85ae89d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.583528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.584371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.587923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.587923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] PATH_INFO: `/v3/projects/4e0fbb81579b40d792c40826ae506016` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.587923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0fbb81579b40d792c40826ae506016)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.588229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.654574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1011/2059] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:17 2021] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:17.655456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ecb96-7004-4ec4-a300-13572d9fe469 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.716414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0fbb81579b40d792c40826ae506016', 'request_id': 'req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.731235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ecb96-7004-4ec4-a300-13572d9fe469 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.784291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.785175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.785453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.785726 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] PATH_INFO: `/v3/projects/df8f6a9cc4c6440caa1ebd9bca7a1f24/users/8c169c07917a48d393f6017dface546f/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.799566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8f6a9cc4c6440caa1ebd9bca7a1f24, user_id=8c169c07917a48d393f6017dface546f, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.802205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.812322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0fbb81579b40d792c40826ae506016', 'request_id': 'req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.818229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0fbb81579b40d792c40826ae506016', 'request_id': 'req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.829753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] The token cache is being invalidate because project 4e0fbb81579b40d792c40826ae506016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:17.830034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.830779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:17.832304 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1049/2060] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:17 2021] DELETE /identity/v3/projects/4e0fbb81579b40d792c40826ae506016 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:17.833113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.834387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.848881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6138d7-e2e0-49cc-9c4c-f6d275d3f3a0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.855538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.856201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.856700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.859166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.859166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.862095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.888503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1012/2061] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:17 2021] PUT /identity/v3/projects/df8f6a9cc4c6440caa1ebd9bca7a1f24/users/8c169c07917a48d393f6017dface546f/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:17.890571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.893221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.955795 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1050/2062] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:17 2021] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:17.968285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:17.968285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:17.968507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b48a4-36d7-4abb-91d5-00d95e8378d7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.968507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.968507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.968507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.968873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] PATH_INFO: `/v3/users/ed545ca558134bbbb7a8c3b261f85105` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.968959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed545ca558134bbbb7a8c3b261f85105)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.970915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.973886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c184-acf6-41fc-8c51-5b37ab5a01db admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:17.980616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45a4e-8bb9-4100-a1bf-eb84bb00fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:17.980616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45a4e-8bb9-4100-a1bf-eb84bb00fda9 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:17.980616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45a4e-8bb9-4100-a1bf-eb84bb00fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:17.980616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45a4e-8bb9-4100-a1bf-eb84bb00fda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:17.981362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45a4e-8bb9-4100-a1bf-eb84bb00fda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:17.986591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45a4e-8bb9-4100-a1bf-eb84bb00fda9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:17.994183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1051/2063] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:17 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:17.995001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45a4e-8bb9-4100-a1bf-eb84bb00fda9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:18.004756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45a4e-8bb9-4100-a1bf-eb84bb00fda9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:18.009465 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d749a1-0092-4fdb-a3c1-8540d6fb5701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:18.010145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d749a1-0092-4fdb-a3c1-8540d6fb5701 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.010423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d749a1-0092-4fdb-a3c1-8540d6fb5701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.010719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d749a1-0092-4fdb-a3c1-8540d6fb5701 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.011443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d749a1-0092-4fdb-a3c1-8540d6fb5701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:18.013021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d749a1-0092-4fdb-a3c1-8540d6fb5701 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:18.023415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1052/2064] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:18.024236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d749a1-0092-4fdb-a3c1-8540d6fb5701 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:18.035992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d749a1-0092-4fdb-a3c1-8540d6fb5701 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:18.038755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef137c0-467f-4734-9885-0f1a10ac5038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:18.039676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef137c0-467f-4734-9885-0f1a10ac5038 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.039953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef137c0-467f-4734-9885-0f1a10ac5038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.040221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef137c0-467f-4734-9885-0f1a10ac5038 admin admin] PATH_INFO: `/v3/projects/df8f6a9cc4c6440caa1ebd9bca7a1f24/users/8c169c07917a48d393f6017dface546f/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.042928 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef137c0-467f-4734-9885-0f1a10ac5038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8f6a9cc4c6440caa1ebd9bca7a1f24, user_id=8c169c07917a48d393f6017dface546f, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:18.045557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef137c0-467f-4734-9885-0f1a10ac5038 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:18.056181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1053/2065] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:18 2021] PUT /identity/v3/projects/df8f6a9cc4c6440caa1ebd9bca7a1f24/users/8c169c07917a48d393f6017dface546f/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:18.056889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef137c0-467f-4734-9885-0f1a10ac5038 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:18.126533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef137c0-467f-4734-9885-0f1a10ac5038 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:18.131091 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31050e-3052-463e-b7e8-100454a0b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:18.131778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31050e-3052-463e-b7e8-100454a0b01a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.132053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31050e-3052-463e-b7e8-100454a0b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.132320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31050e-3052-463e-b7e8-100454a0b01a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.133075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31050e-3052-463e-b7e8-100454a0b01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:18.134697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31050e-3052-463e-b7e8-100454a0b01a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:18.144958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1054/2066] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:18 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:18.145976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790ac9-1270-48db-bf09-0a42ec887b22 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.146255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790ac9-1270-48db-bf09-0a42ec887b22 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.146531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790ac9-1270-48db-bf09-0a42ec887b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.175806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-0d790ac9-1270-48db-bf09-0a42ec887b22 None None] MFA Rules not processed for user `8c169c07917a48d393f6017dface546f`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:18.176930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0d790ac9-1270-48db-bf09-0a42ec887b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:18.259008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1055/2067] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:18 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:18.259895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790ac9-1270-48db-bf09-0a42ec887b22 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:18.270058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790ac9-1270-48db-bf09-0a42ec887b22 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:18.275012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:18.276523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.276803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.277073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] PATH_INFO: `/v3/projects/b6c7d23a3d54410d9f56b71affe2e038/users/ee5d8e8eed264beeb441bee48ca4f089/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.283833 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed545ca558134bbbb7a8c3b261f85105'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:18.284495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed545ca558134bbbb7a8c3b261f85105'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:18.285118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed545ca558134bbbb7a8c3b261f85105'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:18.300217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c7d23a3d54410d9f56b71affe2e038, user_id=ee5d8e8eed264beeb441bee48ca4f089, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:18.302916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:18.470109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed545ca558134bbbb7a8c3b261f85105'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:18.476272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1056/2068] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:18 2021] PUT /identity/v3/projects/b6c7d23a3d54410d9f56b71affe2e038/users/ee5d8e8eed264beeb441bee48ca4f089/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:18.477353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:18.479790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:18.482876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-50576513-e68d-4fb1-8b44-de90f2870c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed545ca558134bbbb7a8c3b261f85105'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:18.500301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1013/2069] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:17 2021] DELETE /identity/v3/users/ed545ca558134bbbb7a8c3b261f85105 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:18.529097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff090-39a2-4f17-a2d7-2983d11ad34c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.529668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff090-39a2-4f17-a2d7-2983d11ad34c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.530094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff090-39a2-4f17-a2d7-2983d11ad34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.555791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e905f03-6315-4ae1-b0dd-bdd253e75eed admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:18.559845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d4aff090-39a2-4f17-a2d7-2983d11ad34c None None] MFA Rules not processed for user `ee5d8e8eed264beeb441bee48ca4f089`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:18.561145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d4aff090-39a2-4f17-a2d7-2983d11ad34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:18.614291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:18.614967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.615245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.615514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.617519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:18.628573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1014/2070] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:18 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:18.632973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff090-39a2-4f17-a2d7-2983d11ad34c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:18.634427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d4aff090-39a2-4f17-a2d7-2983d11ad34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:18.690318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:18.692095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:18.703512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff090-39a2-4f17-a2d7-2983d11ad34c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:18.706246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1057/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:18 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:18.709460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:18.710132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.710405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.710870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.711748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:18.714528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:18.854419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1015/2072] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:18 2021] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:18.858776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:18.869212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313de311-84c0-473f-af5e-f3db92e9ecd3 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:18.924273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dffa8b-793f-4596-880a-a5383c7dfe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:18.924929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffa8b-793f-4596-880a-a5383c7dfe29 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.925289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffa8b-793f-4596-880a-a5383c7dfe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.925561 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffa8b-793f-4596-880a-a5383c7dfe29 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.926248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dffa8b-793f-4596-880a-a5383c7dfe29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:18.928187 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dffa8b-793f-4596-880a-a5383c7dfe29 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:18.940774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:18.943043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:18.956307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b184f-6fe2-459e-a11e-87f46f5d3eff admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:18.961152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:18.962033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:18.962314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:18.962733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] PATH_INFO: `/v3/projects/991ca76b8052453daee096462b253aaa` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:18.964501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991ca76b8052453daee096462b253aaa)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:18.966489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.014016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1058/2073] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:18 2021] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:19.020766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dffa8b-793f-4596-880a-a5383c7dfe29 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.031755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dffa8b-793f-4596-880a-a5383c7dfe29 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.037664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5f1ad-d73f-4542-8b10-7c6c58b48c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.038357 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5f1ad-d73f-4542-8b10-7c6c58b48c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.038718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5f1ad-d73f-4542-8b10-7c6c58b48c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.038993 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5f1ad-d73f-4542-8b10-7c6c58b48c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.039750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5f1ad-d73f-4542-8b10-7c6c58b48c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.041334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5f1ad-d73f-4542-8b10-7c6c58b48c72 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.052358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1059/2074] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:19.056243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5f1ad-d73f-4542-8b10-7c6c58b48c72 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.067030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5f1ad-d73f-4542-8b10-7c6c58b48c72 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.071606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.072457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.073250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.073521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] PATH_INFO: `/v3/projects/384b6e03ed0046efb2dcdfce05e45369/users/b63482dff6414e96b9ddc7e15ddec563/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.099315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384b6e03ed0046efb2dcdfce05e45369, user_id=b63482dff6414e96b9ddc7e15ddec563, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.102378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.112785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991ca76b8052453daee096462b253aaa', 'request_id': 'req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:19.202341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991ca76b8052453daee096462b253aaa', 'request_id': 'req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:19.210349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1060/2075] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:19 2021] PUT /identity/v3/projects/384b6e03ed0046efb2dcdfce05e45369/users/b63482dff6414e96b9ddc7e15ddec563/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:19.211058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991ca76b8052453daee096462b253aaa', 'request_id': 'req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:19.211803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.214578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:19.226646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] The token cache is being invalidate because project 991ca76b8052453daee096462b253aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:19.227184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:19.230033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:19.230033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1016/2076] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:18 2021] DELETE /identity/v3/projects/991ca76b8052453daee096462b253aaa => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:19.230830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.232171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:19.314765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edfb20-860f-4b98-8dd7-e6d4a7d692b5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.322007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f88545-db82-4e20-b4d2-76accb71d331 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.326113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.326871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.327237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.327585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.329852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:19.376085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209d3b-a26c-4b79-88a2-b23169d7fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.376983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209d3b-a26c-4b79-88a2-b23169d7fde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.377266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209d3b-a26c-4b79-88a2-b23169d7fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.377571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209d3b-a26c-4b79-88a2-b23169d7fde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.378288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c209d3b-a26c-4b79-88a2-b23169d7fde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.379912 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c209d3b-a26c-4b79-88a2-b23169d7fde7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.395249 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1017/2077] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:19.395249 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd0d2-83ba-4547-a556-80904efbc26c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.395249 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd0d2-83ba-4547-a556-80904efbc26c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.395249 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd0d2-83ba-4547-a556-80904efbc26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.398137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.399701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.410227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1061/2078] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:19 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:19.410908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.415733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a9afd0d2-83ba-4547-a556-80904efbc26c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:19.419376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a9afd0d2-83ba-4547-a556-80904efbc26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:19.422789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862c61-974d-45b4-ae7f-9833b62e0852 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.430581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1018/2079] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:19.430749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce13b4-e9c4-41c2-9ace-0b4b9d5d0c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.431111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce13b4-e9c4-41c2-9ace-0b4b9d5d0c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.431389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce13b4-e9c4-41c2-9ace-0b4b9d5d0c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.431669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce13b4-e9c4-41c2-9ace-0b4b9d5d0c3f admin admin] PATH_INFO: `/v3/projects/384b6e03ed0046efb2dcdfce05e45369/users/b63482dff6414e96b9ddc7e15ddec563/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.434029 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce13b4-e9c4-41c2-9ace-0b4b9d5d0c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=384b6e03ed0046efb2dcdfce05e45369, user_id=b63482dff6414e96b9ddc7e15ddec563, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.435660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48bed7-ca15-4000-a49a-7a21904aa714 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.436178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48bed7-ca15-4000-a49a-7a21904aa714 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.436596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48bed7-ca15-4000-a49a-7a21904aa714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.436908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce13b4-e9c4-41c2-9ace-0b4b9d5d0c3f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.450380 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1062/2080] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:19 2021] PUT /identity/v3/projects/384b6e03ed0046efb2dcdfce05e45369/users/b63482dff6414e96b9ddc7e15ddec563/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:19.457686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-8d48bed7-ca15-4000-a49a-7a21904aa714 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:19.459080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8d48bed7-ca15-4000-a49a-7a21904aa714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:19.461194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3251-4606-4f63-88b2-a39745832c7c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.461500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3251-4606-4f63-88b2-a39745832c7c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.461780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b3251-4606-4f63-88b2-a39745832c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.499219 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-db5b3251-4606-4f63-88b2-a39745832c7c None None] MFA Rules not processed for user `b63482dff6414e96b9ddc7e15ddec563`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:19.500511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-db5b3251-4606-4f63-88b2-a39745832c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:19.523357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1019/2081] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:19.528192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48bed7-ca15-4000-a49a-7a21904aa714 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.551364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48bed7-ca15-4000-a49a-7a21904aa714 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.557699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.558647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.558934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.559223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.560169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:19.560474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.562210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.578305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1020/2082] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:15:19.579435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.582353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1063/2083] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:19 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:19.589770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e5d9d-e5c3-4efe-8c44-b55b0f5fdae6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.594497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d6d17-5305-4835-8bd7-c9a2cffb64d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.595169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6d17-5305-4835-8bd7-c9a2cffb64d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.595451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6d17-5305-4835-8bd7-c9a2cffb64d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.595738 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6d17-5305-4835-8bd7-c9a2cffb64d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.596428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d6d17-5305-4835-8bd7-c9a2cffb64d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.598310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d6d17-5305-4835-8bd7-c9a2cffb64d1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.722961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1021/2084] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:19 2021] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:19.727249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b3251-4606-4f63-88b2-a39745832c7c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.738319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b3251-4606-4f63-88b2-a39745832c7c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.793573 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067c29-a200-4d4a-8b27-a7c7e5305af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.794162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067c29-a200-4d4a-8b27-a7c7e5305af4 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.794439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067c29-a200-4d4a-8b27-a7c7e5305af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.794748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b067c29-a200-4d4a-8b27-a7c7e5305af4 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.795452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b067c29-a200-4d4a-8b27-a7c7e5305af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.797360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b067c29-a200-4d4a-8b27-a7c7e5305af4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.932958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1064/2085] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:19 2021] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:19.937141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d6d17-5305-4835-8bd7-c9a2cffb64d1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.947101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d6d17-5305-4835-8bd7-c9a2cffb64d1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.952347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322046-56b8-4e87-84fa-9e858f0b8779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.953000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322046-56b8-4e87-84fa-9e858f0b8779 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.953274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322046-56b8-4e87-84fa-9e858f0b8779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.953592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87322046-56b8-4e87-84fa-9e858f0b8779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.954322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87322046-56b8-4e87-84fa-9e858f0b8779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.955920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87322046-56b8-4e87-84fa-9e858f0b8779 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:19.965563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1022/2086] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:19.969596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067c29-a200-4d4a-8b27-a7c7e5305af4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:19.980461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b067c29-a200-4d4a-8b27-a7c7e5305af4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:19.985631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:19.995076 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:19.996277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:19.996572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:19.997408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:19.999154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:20.009815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1065/2087] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:20.019057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322046-56b8-4e87-84fa-9e858f0b8779 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:20.028955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87322046-56b8-4e87-84fa-9e858f0b8779 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:20.033513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18c0ac-62ea-4d2b-939a-ce3f5478556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:20.034381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18c0ac-62ea-4d2b-939a-ce3f5478556d admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:20.034690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18c0ac-62ea-4d2b-939a-ce3f5478556d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:20.034964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18c0ac-62ea-4d2b-939a-ce3f5478556d admin admin] PATH_INFO: `/v3/projects/2fb389bd85d14905b8fb1a86aa955154/users/096eda600717459693b0576a9ea0fe31/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:20.049236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18c0ac-62ea-4d2b-939a-ce3f5478556d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb389bd85d14905b8fb1a86aa955154, user_id=096eda600717459693b0576a9ea0fe31, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:20.051866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18c0ac-62ea-4d2b-939a-ce3f5478556d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:20.085831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:20.087605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:20.148770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b330e1-147c-40b5-9b53-857fbf9a8c22 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:20.152493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f85f-b581-4ee1-81e3-e976874391bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:20.153193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f85f-b581-4ee1-81e3-e976874391bd service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:20.153411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f85f-b581-4ee1-81e3-e976874391bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:20.153751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f85f-b581-4ee1-81e3-e976874391bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:20.188494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1023/2088] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:20 2021] PUT /identity/v3/projects/2fb389bd85d14905b8fb1a86aa955154/users/096eda600717459693b0576a9ea0fe31/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:20.199583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7490471-cedf-4125-a6ff-7423af8012ba None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:20.199977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7490471-cedf-4125-a6ff-7423af8012ba None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:20.200749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7490471-cedf-4125-a6ff-7423af8012ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:20.244276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-f7490471-cedf-4125-a6ff-7423af8012ba None None] MFA Rules not processed for user `096eda600717459693b0576a9ea0fe31`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:20.246091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f7490471-cedf-4125-a6ff-7423af8012ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:20.254074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f85f-b581-4ee1-81e3-e976874391bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:20.254074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f85f-b581-4ee1-81e3-e976874391bd service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:20.277276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1066/2089] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:20 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:20.330687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1024/2090] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:20.331602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f85f-b581-4ee1-81e3-e976874391bd service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:20.343740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f85f-b581-4ee1-81e3-e976874391bd service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:20.405466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b2c3-dc81-4119-ad5d-a5aad52ce295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:20.406129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b2c3-dc81-4119-ad5d-a5aad52ce295 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:20.406406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b2c3-dc81-4119-ad5d-a5aad52ce295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:20.406710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b2c3-dc81-4119-ad5d-a5aad52ce295 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:20.407412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74b2c3-dc81-4119-ad5d-a5aad52ce295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:20.409304 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74b2c3-dc81-4119-ad5d-a5aad52ce295 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:20.513090 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7490471-cedf-4125-a6ff-7423af8012ba None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:20.514509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f7490471-cedf-4125-a6ff-7423af8012ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:20.528268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7490471-cedf-4125-a6ff-7423af8012ba None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:20.533429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:20.537876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:20.537876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:20.538241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1067/2091] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:20 2021] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:20.538333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] PATH_INFO: `/v3/users/ccc9a35d5326452ca3cdbd6a199f3670` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:20.538333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc9a35d5326452ca3cdbd6a199f3670)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:20.539134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:20.547826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b2c3-dc81-4119-ad5d-a5aad52ce295 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:20.609931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b2c3-dc81-4119-ad5d-a5aad52ce295 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:20.614403 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fba811-8397-4112-9e00-18f98aaf5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:20.615107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fba811-8397-4112-9e00-18f98aaf5134 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:20.615390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fba811-8397-4112-9e00-18f98aaf5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:20.615658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fba811-8397-4112-9e00-18f98aaf5134 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:20.616365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fba811-8397-4112-9e00-18f98aaf5134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:20.618337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fba811-8397-4112-9e00-18f98aaf5134 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:20.772687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1068/2092] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:20 2021] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:20.777221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fba811-8397-4112-9e00-18f98aaf5134 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:20.786331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fba811-8397-4112-9e00-18f98aaf5134 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:20.790981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79186c73-dbef-4c3a-a55c-0f6d3d61d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:20.792211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79186c73-dbef-4c3a-a55c-0f6d3d61d2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:20.792489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79186c73-dbef-4c3a-a55c-0f6d3d61d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:20.792757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79186c73-dbef-4c3a-a55c-0f6d3d61d2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:20.793475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79186c73-dbef-4c3a-a55c-0f6d3d61d2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:20.795057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79186c73-dbef-4c3a-a55c-0f6d3d61d2ab admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:20.804496 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1069/2093] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:20 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:20.808433 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79186c73-dbef-4c3a-a55c-0f6d3d61d2ab admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:20.817494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79186c73-dbef-4c3a-a55c-0f6d3d61d2ab admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:20.822010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:20.822879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:20.823157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:20.823430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] PATH_INFO: `/v3/projects/ca5ef15dfcf040978a77e5cee0b58952/users/a5c914a2c1d5445cb3c19c2ad61eb2e1/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:20.837271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5ef15dfcf040978a77e5cee0b58952, user_id=a5c914a2c1d5445cb3c19c2ad61eb2e1, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:20.840486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:20.857065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc9a35d5326452ca3cdbd6a199f3670'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:20.863465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc9a35d5326452ca3cdbd6a199f3670'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:20.863465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc9a35d5326452ca3cdbd6a199f3670'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:21.006984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1070/2094] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:20 2021] PUT /identity/v3/projects/ca5ef15dfcf040978a77e5cee0b58952/users/a5c914a2c1d5445cb3c19c2ad61eb2e1/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:21.007798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:21.009329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.052501 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc9a35d5326452ca3cdbd6a199f3670'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:21.064838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc9a35d5326452ca3cdbd6a199f3670'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:21.070145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db4489-b5ae-4475-8bc5-faa644d14f33 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:21.075798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:21.076716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.076995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.077096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1025/2095] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:20 2021] DELETE /identity/v3/users/ccc9a35d5326452ca3cdbd6a199f3670 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:21.077264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] PATH_INFO: `/v3/users/ee5d8e8eed264beeb441bee48ca4f089` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.077884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:21.079237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.080670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5d8e8eed264beeb441bee48ca4f089)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:21.082591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:21.141172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9212b7-b72d-42f7-ab46-a2a136de1f83 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:21.145668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6916d-2b8f-4837-9bb2-3a280a283d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:21.146328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6916d-2b8f-4837-9bb2-3a280a283d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.146644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6916d-2b8f-4837-9bb2-3a280a283d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.146978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6916d-2b8f-4837-9bb2-3a280a283d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.147750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6916d-2b8f-4837-9bb2-3a280a283d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:21.149325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6916d-2b8f-4837-9bb2-3a280a283d74 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:21.159732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1026/2096] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:21 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:21.161969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f1fc-d336-4157-b1e1-4e1e898c8f74 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.161969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f1fc-d336-4157-b1e1-4e1e898c8f74 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.161969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f1fc-d336-4157-b1e1-4e1e898c8f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.178676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6285f1fc-d336-4157-b1e1-4e1e898c8f74 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:21.179867 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6285f1fc-d336-4157-b1e1-4e1e898c8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.187684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1027/2097] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:21.188656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285f1fc-d336-4157-b1e1-4e1e898c8f74 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:21.200230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285f1fc-d336-4157-b1e1-4e1e898c8f74 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:21.204989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:21.211247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.211247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.211247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] PATH_INFO: `/v3/projects/ca5ef15dfcf040978a77e5cee0b58952/users/a5c914a2c1d5445cb3c19c2ad61eb2e1/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.211247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5ef15dfcf040978a77e5cee0b58952, user_id=a5c914a2c1d5445cb3c19c2ad61eb2e1, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:21.211700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:21.222917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1028/2098] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:21 2021] PUT /identity/v3/projects/ca5ef15dfcf040978a77e5cee0b58952/users/a5c914a2c1d5445cb3c19c2ad61eb2e1/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:21.223583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:21.225087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.289310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecced1-2544-46b5-a017-24b40ebfc62e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:21.293048 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96719716-d3d4-4358-8423-3e6ef40be709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:21.293688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96719716-d3d4-4358-8423-3e6ef40be709 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.293972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96719716-d3d4-4358-8423-3e6ef40be709 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.294247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96719716-d3d4-4358-8423-3e6ef40be709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.324757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5d8e8eed264beeb441bee48ca4f089'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:21.325513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5d8e8eed264beeb441bee48ca4f089'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:21.326188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5d8e8eed264beeb441bee48ca4f089'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:21.356255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96719716-d3d4-4358-8423-3e6ef40be709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:21.357692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96719716-d3d4-4358-8423-3e6ef40be709 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:21.366999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1029/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:21.368236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f5d4-ab2f-48e0-a102-c0e7a6924aba None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.368519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f5d4-ab2f-48e0-a102-c0e7a6924aba None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.368786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f5d4-ab2f-48e0-a102-c0e7a6924aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.397633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-81c1f5d4-ab2f-48e0-a102-c0e7a6924aba None None] MFA Rules not processed for user `a5c914a2c1d5445cb3c19c2ad61eb2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:21.397633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-81c1f5d4-ab2f-48e0-a102-c0e7a6924aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.430115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5d8e8eed264beeb441bee48ca4f089'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:21.452198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-67109667-d99a-433b-a786-ccea6566769c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5d8e8eed264beeb441bee48ca4f089'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:21.464959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1071/2100] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:21 2021] DELETE /identity/v3/users/ee5d8e8eed264beeb441bee48ca4f089 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:21.469773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c288bc2-bb01-49c8-8570-1324e4580d8f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.470059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c288bc2-bb01-49c8-8570-1324e4580d8f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.470337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c288bc2-bb01-49c8-8570-1324e4580d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.475087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1030/2101] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:21 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:21.485581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1f5d4-ab2f-48e0-a102-c0e7a6924aba None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:21.489747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-81c1f5d4-ab2f-48e0-a102-c0e7a6924aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.489856 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9c288bc2-bb01-49c8-8570-1324e4580d8f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:21.492198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9c288bc2-bb01-49c8-8570-1324e4580d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.563366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1072/2102] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:21.574812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c288bc2-bb01-49c8-8570-1324e4580d8f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:21.576352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9c288bc2-bb01-49c8-8570-1324e4580d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.653147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c288bc2-bb01-49c8-8570-1324e4580d8f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:21.659124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:21.659995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.660430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.660962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.674877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:21.676860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:21.684673 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1f5d4-ab2f-48e0-a102-c0e7a6924aba None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:21.689211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1073/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:21.746827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea1cbc-c753-451b-9475-6d737ab7f3da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:21.747559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1cbc-c753-451b-9475-6d737ab7f3da service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.747847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1cbc-c753-451b-9475-6d737ab7f3da service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.748119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1cbc-c753-451b-9475-6d737ab7f3da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.808638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea1cbc-c753-451b-9475-6d737ab7f3da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:21.810124 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea1cbc-c753-451b-9475-6d737ab7f3da service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:21.819505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1031/2104] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:21 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:21.911532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:21.912400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea1cbc-c753-451b-9475-6d737ab7f3da service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:21.913073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.921228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea1cbc-c753-451b-9475-6d737ab7f3da service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:21.926054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:21.926736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.927009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.927285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.928049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29fe52-3b2b-43cb-826b-c3cb036cdd9d service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:21.929112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:21.933618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:21.934879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:21.935384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:21.936007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] PATH_INFO: `/v3/projects/6212cf4db71a4c42b0e47a46686bf4f7` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:21.937128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6212cf4db71a4c42b0e47a46686bf4f7)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:21.939610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:21.992859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:21.994477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:22.004974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1032/2105] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:21 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:22.066787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6212cf4db71a4c42b0e47a46686bf4f7', 'request_id': 'req-9f217d49-1dd4-4541-90eb-3a6e164f548d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.144635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6212cf4db71a4c42b0e47a46686bf4f7', 'request_id': 'req-9f217d49-1dd4-4541-90eb-3a6e164f548d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.150467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6212cf4db71a4c42b0e47a46686bf4f7', 'request_id': 'req-9f217d49-1dd4-4541-90eb-3a6e164f548d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.162320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] The token cache is being invalidate because project 6212cf4db71a4c42b0e47a46686bf4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:22.162638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.163280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.164891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1074/2106] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:21 2021] DELETE /identity/v3/projects/6212cf4db71a4c42b0e47a46686bf4f7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:22.169477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:22.180022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e15cd-a55e-4e89-ae0a-96d53d41eaa5 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:22.214969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:22.216440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:22.242118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:22.243162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:22.243542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:22.243732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] PATH_INFO: `/v3/users/6283294471aa45a6b64a39622d2827d9` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:22.245107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6283294471aa45a6b64a39622d2827d9)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:22.247270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:22.301311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f217d49-1dd4-4541-90eb-3a6e164f548d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:22.305944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:22.306852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:22.307162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:22.307425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] PATH_INFO: `/v3/projects/b6c7d23a3d54410d9f56b71affe2e038` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:22.308637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c7d23a3d54410d9f56b71affe2e038)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:22.310526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:22.649026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6283294471aa45a6b64a39622d2827d9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.649672 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6283294471aa45a6b64a39622d2827d9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.650305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6283294471aa45a6b64a39622d2827d9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.653490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c7d23a3d54410d9f56b71affe2e038', 'request_id': 'req-718be413-e73c-4e38-88a2-c74a559857df'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.761427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6283294471aa45a6b64a39622d2827d9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.774603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6283294471aa45a6b64a39622d2827d9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.787763 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1033/2107] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:22 2021] DELETE /identity/v3/users/6283294471aa45a6b64a39622d2827d9 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:22.858912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c7d23a3d54410d9f56b71affe2e038', 'request_id': 'req-718be413-e73c-4e38-88a2-c74a559857df'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.865948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c7d23a3d54410d9f56b71affe2e038', 'request_id': 'req-718be413-e73c-4e38-88a2-c74a559857df'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.889524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] The token cache is being invalidate because project b6c7d23a3d54410d9f56b71affe2e038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:22.893676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.893676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:22.893676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1075/2108] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:22 2021] DELETE /identity/v3/projects/b6c7d23a3d54410d9f56b71affe2e038 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:22.903009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:22.904635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:22.987315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140b61-99c4-44d1-8d73-a2e9f89afb1e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:22.991995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:22.992796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:22.993080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:22.993353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] PATH_INFO: `/v3/users/b63482dff6414e96b9ddc7e15ddec563` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:22.995161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63482dff6414e96b9ddc7e15ddec563)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:22.997057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:23.225245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63482dff6414e96b9ddc7e15ddec563'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.225894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63482dff6414e96b9ddc7e15ddec563'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.226623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63482dff6414e96b9ddc7e15ddec563'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.265953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:23.267401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:23.299294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63482dff6414e96b9ddc7e15ddec563'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.305868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-31f65f77-1d01-45cc-ab6c-d951f44cafd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63482dff6414e96b9ddc7e15ddec563'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.319975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1034/2109] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:22 2021] DELETE /identity/v3/users/b63482dff6414e96b9ddc7e15ddec563 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:23.347095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718be413-e73c-4e38-88a2-c74a559857df admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:23.411391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:23.412421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:23.412688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:23.412956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] PATH_INFO: `/v3/projects/9cedd31d960d4572bbae4219521823ba` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:23.414164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cedd31d960d4572bbae4219521823ba)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:23.416685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:23.578507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cedd31d960d4572bbae4219521823ba', 'request_id': 'req-766707c3-f4c4-4371-93f9-c28a08ba3ff4'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.686875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cedd31d960d4572bbae4219521823ba', 'request_id': 'req-766707c3-f4c4-4371-93f9-c28a08ba3ff4'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.693551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cedd31d960d4572bbae4219521823ba', 'request_id': 'req-766707c3-f4c4-4371-93f9-c28a08ba3ff4'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.705179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] The token cache is being invalidate because project 9cedd31d960d4572bbae4219521823ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:23.705463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.706102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-766707c3-f4c4-4371-93f9-c28a08ba3ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:23.707652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1076/2110] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:23 2021] DELETE /identity/v3/projects/9cedd31d960d4572bbae4219521823ba => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:23.715123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207367c4-6629-4a2d-808f-36986ee1c39c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:23.715405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207367c4-6629-4a2d-808f-36986ee1c39c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:23.715676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207367c4-6629-4a2d-808f-36986ee1c39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:23.733828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-207367c4-6629-4a2d-808f-36986ee1c39c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:23.735075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-207367c4-6629-4a2d-808f-36986ee1c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:23.794639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1035/2111] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:23.801804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63501d28-e9b3-45e0-8b45-18f738e9e5b1 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:23.802226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63501d28-e9b3-45e0-8b45-18f738e9e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:23.802663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63501d28-e9b3-45e0-8b45-18f738e9e5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:23.802842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207367c4-6629-4a2d-808f-36986ee1c39c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:23.804292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-207367c4-6629-4a2d-808f-36986ee1c39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:23.816702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207367c4-6629-4a2d-808f-36986ee1c39c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:23.823737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-63501d28-e9b3-45e0-8b45-18f738e9e5b1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:23.823940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:23.824815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:23.824927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-63501d28-e9b3-45e0-8b45-18f738e9e5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:23.825262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:23.825664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] PATH_INFO: `/v3/projects/384b6e03ed0046efb2dcdfce05e45369` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:23.827032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384b6e03ed0046efb2dcdfce05e45369)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:23.828937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:23.836638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1077/2112] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:23.837806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63501d28-e9b3-45e0-8b45-18f738e9e5b1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:23.847975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63501d28-e9b3-45e0-8b45-18f738e9e5b1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:23.852846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:23.853530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:23.853867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:23.854392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:23.855177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:23.855479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:23.857065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:23.868442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1078/2113] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:23.873528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:23.883183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0927f-f285-4dee-8572-e8e5cbb7714d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:23.888377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb08905-8801-47b6-84e6-465840803666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:23.889014 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08905-8801-47b6-84e6-465840803666 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:23.889294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08905-8801-47b6-84e6-465840803666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:23.889565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08905-8801-47b6-84e6-465840803666 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:23.890249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb08905-8801-47b6-84e6-465840803666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:23.892155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb08905-8801-47b6-84e6-465840803666 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:23.944075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384b6e03ed0046efb2dcdfce05e45369', 'request_id': 'req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:24.064172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384b6e03ed0046efb2dcdfce05e45369', 'request_id': 'req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:24.070046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384b6e03ed0046efb2dcdfce05e45369', 'request_id': 'req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:24.076062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1079/2114] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:23 2021] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:24.080446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb08905-8801-47b6-84e6-465840803666 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.084494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] The token cache is being invalidate because project 384b6e03ed0046efb2dcdfce05e45369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:24.084779 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:24.085472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b0beb3b0-1d05-4105-90c8-df22ae80f5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:24.087314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1036/2115] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:23 2021] DELETE /identity/v3/projects/384b6e03ed0046efb2dcdfce05e45369 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:24.093143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7639c-b911-4ef9-b78a-0457d0d78a88 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.094087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7639c-b911-4ef9-b78a-0457d0d78a88 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.094087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7639c-b911-4ef9-b78a-0457d0d78a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.115104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-69f7639c-b911-4ef9-b78a-0457d0d78a88 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:24.116317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-69f7639c-b911-4ef9-b78a-0457d0d78a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:24.152036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb08905-8801-47b6-84e6-465840803666 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.157450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.158327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.158776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.159133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.160131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.162866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.180470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1037/2116] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:24.188634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff6051-3996-41e7-af8d-07d55533cb46 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.188917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff6051-3996-41e7-af8d-07d55533cb46 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.189265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff6051-3996-41e7-af8d-07d55533cb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.206716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b6ff6051-3996-41e7-af8d-07d55533cb46 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:24.207896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b6ff6051-3996-41e7-af8d-07d55533cb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:24.216003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1038/2117] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:24.225706 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff6051-3996-41e7-af8d-07d55533cb46 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.235105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff6051-3996-41e7-af8d-07d55533cb46 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.239690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.240312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.240589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.240861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.241578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:24.241885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.243495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.252739 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1080/2118] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:24.259644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1039/2119] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:15:24.259803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.259803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:24.260639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.270233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083314-2128-493b-ab37-7a3d298309f9 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.270377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589c803-35c7-4a73-b74a-02e26b2bc242 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.274772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f61c4-0c26-479b-95a5-9eafe925f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.275317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924a7d9-5f7a-4d10-8682-b8f97abfa4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.275425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f61c4-0c26-479b-95a5-9eafe925f759 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.275677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f61c4-0c26-479b-95a5-9eafe925f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.275947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f61c4-0c26-479b-95a5-9eafe925f759 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.276047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a7d9-5f7a-4d10-8682-b8f97abfa4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.276243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a7d9-5f7a-4d10-8682-b8f97abfa4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.276523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a7d9-5f7a-4d10-8682-b8f97abfa4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.276699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f61c4-0c26-479b-95a5-9eafe925f759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.277216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924a7d9-5f7a-4d10-8682-b8f97abfa4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.278264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f61c4-0c26-479b-95a5-9eafe925f759 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.279234 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924a7d9-5f7a-4d10-8682-b8f97abfa4a8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.288208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1081/2120] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:24.293084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f61c4-0c26-479b-95a5-9eafe925f759 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.302706 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f61c4-0c26-479b-95a5-9eafe925f759 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.307958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e0b24-9b2c-46ba-9a7e-a4b7778b6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.308599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e0b24-9b2c-46ba-9a7e-a4b7778b6862 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.308880 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e0b24-9b2c-46ba-9a7e-a4b7778b6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.309210 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e0b24-9b2c-46ba-9a7e-a4b7778b6862 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.309899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e0b24-9b2c-46ba-9a7e-a4b7778b6862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.311505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e0b24-9b2c-46ba-9a7e-a4b7778b6862 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.321347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1082/2121] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:24.325142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e0b24-9b2c-46ba-9a7e-a4b7778b6862 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.334294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e0b24-9b2c-46ba-9a7e-a4b7778b6862 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.339275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae7f8d-3ccd-4ef9-b1df-b6bc9032a775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.339971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7f8d-3ccd-4ef9-b1df-b6bc9032a775 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.340247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7f8d-3ccd-4ef9-b1df-b6bc9032a775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.340518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae7f8d-3ccd-4ef9-b1df-b6bc9032a775 admin admin] PATH_INFO: `/v3/projects/b705ffdb92b94b20a00f6cf12b427ed4/users/90adec7d9e644481846e4dfbe73d6352/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.356822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae7f8d-3ccd-4ef9-b1df-b6bc9032a775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b705ffdb92b94b20a00f6cf12b427ed4, user_id=90adec7d9e644481846e4dfbe73d6352, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.359565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae7f8d-3ccd-4ef9-b1df-b6bc9032a775 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.426562 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1040/2122] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:24.431478 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924a7d9-5f7a-4d10-8682-b8f97abfa4a8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.453473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1083/2123] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:24 2021] PUT /identity/v3/projects/b705ffdb92b94b20a00f6cf12b427ed4/users/90adec7d9e644481846e4dfbe73d6352/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:24.468653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bd7d-64d2-491e-bcce-9b0817738ab9 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.469103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bd7d-64d2-491e-bcce-9b0817738ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.469381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06bd7d-64d2-491e-bcce-9b0817738ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.505092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-5a06bd7d-64d2-491e-bcce-9b0817738ab9 None None] MFA Rules not processed for user `90adec7d9e644481846e4dfbe73d6352`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:24.506294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5a06bd7d-64d2-491e-bcce-9b0817738ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:24.507196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924a7d9-5f7a-4d10-8682-b8f97abfa4a8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.580138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eaa9b-fed1-479a-b18a-d46f6b28b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.580807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eaa9b-fed1-479a-b18a-d46f6b28b2ca admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.580918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1084/2124] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:24.581196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eaa9b-fed1-479a-b18a-d46f6b28b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.581431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eaa9b-fed1-479a-b18a-d46f6b28b2ca admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.582236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138eaa9b-fed1-479a-b18a-d46f6b28b2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.584325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138eaa9b-fed1-479a-b18a-d46f6b28b2ca admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.591149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06bd7d-64d2-491e-bcce-9b0817738ab9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.602097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06bd7d-64d2-491e-bcce-9b0817738ab9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.616061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71655402-19c3-41a4-b328-f3afb24a4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.616886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71655402-19c3-41a4-b328-f3afb24a4385 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.617311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71655402-19c3-41a4-b328-f3afb24a4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.617631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71655402-19c3-41a4-b328-f3afb24a4385 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.619300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71655402-19c3-41a4-b328-f3afb24a4385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.621252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71655402-19c3-41a4-b328-f3afb24a4385 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.670484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1041/2125] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:24.675152 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eaa9b-fed1-479a-b18a-d46f6b28b2ca admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.685067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138eaa9b-fed1-479a-b18a-d46f6b28b2ca admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.689780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170992f2-c8f5-42ec-bfc9-4e59f38e8b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.690431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170992f2-c8f5-42ec-bfc9-4e59f38e8b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.690747 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170992f2-c8f5-42ec-bfc9-4e59f38e8b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.691084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170992f2-c8f5-42ec-bfc9-4e59f38e8b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.691810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170992f2-c8f5-42ec-bfc9-4e59f38e8b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.693470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170992f2-c8f5-42ec-bfc9-4e59f38e8b76 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.703947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1042/2126] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:24.707913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170992f2-c8f5-42ec-bfc9-4e59f38e8b76 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.718527 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170992f2-c8f5-42ec-bfc9-4e59f38e8b76 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.723222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1085/2127] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:24.724546 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eb84c-95d3-4a37-af08-299bf84a311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.726006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb84c-95d3-4a37-af08-299bf84a311b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.726006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb84c-95d3-4a37-af08-299bf84a311b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.726006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb84c-95d3-4a37-af08-299bf84a311b admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.726517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2eb84c-95d3-4a37-af08-299bf84a311b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.728131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2eb84c-95d3-4a37-af08-299bf84a311b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.728718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71655402-19c3-41a4-b328-f3afb24a4385 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.742969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1043/2128] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:24.747047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eb84c-95d3-4a37-af08-299bf84a311b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.767553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eb84c-95d3-4a37-af08-299bf84a311b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.803258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71655402-19c3-41a4-b328-f3afb24a4385 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.808872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a34b44-f620-47c6-8abd-fee8088b4ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.812071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a34b44-f620-47c6-8abd-fee8088b4ada admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.812071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a34b44-f620-47c6-8abd-fee8088b4ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.812071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a34b44-f620-47c6-8abd-fee8088b4ada admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.812071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a34b44-f620-47c6-8abd-fee8088b4ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.812680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a34b44-f620-47c6-8abd-fee8088b4ada admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.827766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3b04e-922c-4275-9779-2e3becad3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.828665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b04e-922c-4275-9779-2e3becad3c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.828943 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b04e-922c-4275-9779-2e3becad3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.829368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3b04e-922c-4275-9779-2e3becad3c4c admin admin] PATH_INFO: `/v3/projects/72534932c4f54edda4799fb2bfd2fe7b/users/1863c113c5dc4b40bf26177a07aaee6e/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.845920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3b04e-922c-4275-9779-2e3becad3c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=72534932c4f54edda4799fb2bfd2fe7b, user_id=1863c113c5dc4b40bf26177a07aaee6e, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.848606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3b04e-922c-4275-9779-2e3becad3c4c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.893067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1086/2129] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:24.897067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a34b44-f620-47c6-8abd-fee8088b4ada admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.907432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a34b44-f620-47c6-8abd-fee8088b4ada admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.912107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e49e3c-5980-445a-922e-d15cd4e61a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:24.912750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e49e3c-5980-445a-922e-d15cd4e61a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.913030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e49e3c-5980-445a-922e-d15cd4e61a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.913303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e49e3c-5980-445a-922e-d15cd4e61a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.914033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e49e3c-5980-445a-922e-d15cd4e61a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:24.915670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e49e3c-5980-445a-922e-d15cd4e61a9f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:24.922965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1044/2130] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:24 2021] PUT /identity/v3/projects/72534932c4f54edda4799fb2bfd2fe7b/users/1863c113c5dc4b40bf26177a07aaee6e/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:24.937109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1087/2131] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:24.937250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1e98-a934-4e74-b890-6e5b3433312a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:24.937377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1e98-a934-4e74-b890-6e5b3433312a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:24.937658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1e98-a934-4e74-b890-6e5b3433312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:24.938103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e49e3c-5980-445a-922e-d15cd4e61a9f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:24.948707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e49e3c-5980-445a-922e-d15cd4e61a9f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:24.968645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-87bc1e98-a934-4e74-b890-6e5b3433312a None None] MFA Rules not processed for user `1863c113c5dc4b40bf26177a07aaee6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:24.969623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-87bc1e98-a934-4e74-b890-6e5b3433312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:25.050667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1045/2132] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:24 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:25.056188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc1e98-a934-4e74-b890-6e5b3433312a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:25.065027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed5a87-448d-4f44-aabd-6092185f8f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:25.066016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed5a87-448d-4f44-aabd-6092185f8f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:25.066298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed5a87-448d-4f44-aabd-6092185f8f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:25.067004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed5a87-448d-4f44-aabd-6092185f8f09 admin admin] PATH_INFO: `/v3/projects/2cca5c92f2fd4818898a3c4ee58b0548/users/2b7cae4ad57a45f282f441d694d7d5f5/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:25.085491 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed5a87-448d-4f44-aabd-6092185f8f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cca5c92f2fd4818898a3c4ee58b0548, user_id=2b7cae4ad57a45f282f441d694d7d5f5, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:25.088763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed5a87-448d-4f44-aabd-6092185f8f09 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:25.130226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc1e98-a934-4e74-b890-6e5b3433312a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:25.135894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad3c74-89cd-49cd-8b35-4f57ca89950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:25.136549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad3c74-89cd-49cd-8b35-4f57ca89950a admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:25.136832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad3c74-89cd-49cd-8b35-4f57ca89950a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:25.137109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad3c74-89cd-49cd-8b35-4f57ca89950a admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:25.138037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad3c74-89cd-49cd-8b35-4f57ca89950a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:25.140101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad3c74-89cd-49cd-8b35-4f57ca89950a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:25.349890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1088/2133] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:24 2021] PUT /identity/v3/projects/2cca5c92f2fd4818898a3c4ee58b0548/users/2b7cae4ad57a45f282f441d694d7d5f5/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:25.519688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed5a87-448d-4f44-aabd-6092185f8f09 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:25.561044 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed5a87-448d-4f44-aabd-6092185f8f09 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:25.565797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2264880-4692-4ff5-9b61-2f11daec0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:25.566425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264880-4692-4ff5-9b61-2f11daec0483 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:25.566723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264880-4692-4ff5-9b61-2f11daec0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:25.566999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264880-4692-4ff5-9b61-2f11daec0483 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:25.567735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2264880-4692-4ff5-9b61-2f11daec0483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:25.569438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2264880-4692-4ff5-9b61-2f11daec0483 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:25.574972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1046/2134] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:25 2021] POST /identity/v3/projects => generated 365 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:25.579113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad3c74-89cd-49cd-8b35-4f57ca89950a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:25.579881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1089/2135] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:25 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:25.584077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2264880-4692-4ff5-9b61-2f11daec0483 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:25.595722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2264880-4692-4ff5-9b61-2f11daec0483 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:25.643489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad3c74-89cd-49cd-8b35-4f57ca89950a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:25.658728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:25.658728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:25.658728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:25.658728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:25.659097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:25.659097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:25.659250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7a60a-ab0c-4754-91b9-c220cb1fabc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:25.659250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a60a-ab0c-4754-91b9-c220cb1fabc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:25.659250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a60a-ab0c-4754-91b9-c220cb1fabc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:25.659250 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a60a-ab0c-4754-91b9-c220cb1fabc4 admin admin] PATH_INFO: `/v3/projects/2cca5c92f2fd4818898a3c4ee58b0548/users/2b7cae4ad57a45f282f441d694d7d5f5/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:25.659582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7a60a-ab0c-4754-91b9-c220cb1fabc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cca5c92f2fd4818898a3c4ee58b0548, user_id=2b7cae4ad57a45f282f441d694d7d5f5, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:25.660352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7a60a-ab0c-4754-91b9-c220cb1fabc4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:25.670687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1090/2136] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:25 2021] PUT /identity/v3/projects/2cca5c92f2fd4818898a3c4ee58b0548/users/2b7cae4ad57a45f282f441d694d7d5f5/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:25.681524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0d75-01c9-4149-9416-d98151c85bac None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:25.681836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0d75-01c9-4149-9416-d98151c85bac None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:25.682111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0d75-01c9-4149-9416-d98151c85bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:25.707517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9fbd0d75-01c9-4149-9416-d98151c85bac None None] MFA Rules not processed for user `2b7cae4ad57a45f282f441d694d7d5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:25.708707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9fbd0d75-01c9-4149-9416-d98151c85bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:25.774672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1091/2137] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:25 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:25.896491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1047/2138] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:25 2021] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:25.897719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0d75-01c9-4149-9416-d98151c85bac None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:25.904757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:25.906511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:25.967692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0d75-01c9-4149-9416-d98151c85bac None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:25.983294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d2cb-8122-45fa-be0e-65ac5fc6387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:25.984106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d2cb-8122-45fa-be0e-65ac5fc6387e admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:25.984441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d2cb-8122-45fa-be0e-65ac5fc6387e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:25.984803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d2cb-8122-45fa-be0e-65ac5fc6387e admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:25.985590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5d2cb-8122-45fa-be0e-65ac5fc6387e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:25.987291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5d2cb-8122-45fa-be0e-65ac5fc6387e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:25.988207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb820-d442-4f08-a7a5-e2171262c96f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:26.002594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1092/2139] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:25 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:26.004399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d2cb-8122-45fa-be0e-65ac5fc6387e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:26.017164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d2cb-8122-45fa-be0e-65ac5fc6387e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:26.021830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cd863-f866-47db-a716-50e6a00adcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:26.022749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cd863-f866-47db-a716-50e6a00adcc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:26.023164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cd863-f866-47db-a716-50e6a00adcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:26.023446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cd863-f866-47db-a716-50e6a00adcc0 admin admin] PATH_INFO: `/v3/projects/7d72f956ace74ab6b468d43af934ca87/users/1900b323f8ca43b89389efdff8f781a9/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:26.038843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cd863-f866-47db-a716-50e6a00adcc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d72f956ace74ab6b468d43af934ca87, user_id=1900b323f8ca43b89389efdff8f781a9, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:26.041591 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cd863-f866-47db-a716-50e6a00adcc0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:26.045246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021523c-831a-4087-a988-a4a9edc7e525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:26.046136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021523c-831a-4087-a988-a4a9edc7e525 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:26.046423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021523c-831a-4087-a988-a4a9edc7e525 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:26.046748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021523c-831a-4087-a988-a4a9edc7e525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:26.056317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021523c-831a-4087-a988-a4a9edc7e525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:26.059823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021523c-831a-4087-a988-a4a9edc7e525 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:26.068143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1048/2140] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:25 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:26.117696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1093/2141] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:26 2021] PUT /identity/v3/projects/7d72f956ace74ab6b468d43af934ca87/users/1900b323f8ca43b89389efdff8f781a9/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:26.121659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021523c-831a-4087-a988-a4a9edc7e525 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:26.132815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021523c-831a-4087-a988-a4a9edc7e525 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:26.189093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8548-3fb4-48dc-a646-77c109c204e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:26.189751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8548-3fb4-48dc-a646-77c109c204e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:26.190027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8548-3fb4-48dc-a646-77c109c204e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:26.190299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8548-3fb4-48dc-a646-77c109c204e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:26.191061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a8548-3fb4-48dc-a646-77c109c204e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:26.192688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a8548-3fb4-48dc-a646-77c109c204e4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:26.203397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1049/2142] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:26.207741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cd863-f866-47db-a716-50e6a00adcc0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:26.218335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cd863-f866-47db-a716-50e6a00adcc0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:26.221639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8548-3fb4-48dc-a646-77c109c204e4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:26.222964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b35f9-72a1-4e98-a410-ab2508af4805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:26.223831 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b35f9-72a1-4e98-a410-ab2508af4805 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:26.224108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b35f9-72a1-4e98-a410-ab2508af4805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:26.224376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b35f9-72a1-4e98-a410-ab2508af4805 admin admin] PATH_INFO: `/v3/projects/7d72f956ace74ab6b468d43af934ca87/users/1900b323f8ca43b89389efdff8f781a9/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:26.226318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b35f9-72a1-4e98-a410-ab2508af4805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d72f956ace74ab6b468d43af934ca87, user_id=1900b323f8ca43b89389efdff8f781a9, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:26.229038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b35f9-72a1-4e98-a410-ab2508af4805 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:26.239441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1094/2143] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:26 2021] PUT /identity/v3/projects/7d72f956ace74ab6b468d43af934ca87/users/1900b323f8ca43b89389efdff8f781a9/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:26.249756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadd3ea-87ba-4a1c-b127-342e2a26829f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:26.249968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadd3ea-87ba-4a1c-b127-342e2a26829f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:26.250238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadd3ea-87ba-4a1c-b127-342e2a26829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:26.277891 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8548-3fb4-48dc-a646-77c109c204e4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:26.278762 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ceadd3ea-87ba-4a1c-b127-342e2a26829f None None] MFA Rules not processed for user `1900b323f8ca43b89389efdff8f781a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:26.281217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ceadd3ea-87ba-4a1c-b127-342e2a26829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:26.325093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3ed6-8f85-4c89-8790-959cf713c295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:26.325873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3ed6-8f85-4c89-8790-959cf713c295 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:26.326149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3ed6-8f85-4c89-8790-959cf713c295 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:26.326423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3ed6-8f85-4c89-8790-959cf713c295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:26.353252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1095/2144] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:26 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:26.392983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d3ed6-8f85-4c89-8790-959cf713c295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:26.394474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d3ed6-8f85-4c89-8790-959cf713c295 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:26.404177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1050/2145] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:26 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:26.430723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadd3ea-87ba-4a1c-b127-342e2a26829f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:26.441394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadd3ea-87ba-4a1c-b127-342e2a26829f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:26.445127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c8b74-d3e9-416d-80a7-2450eac1a27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:26.445764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8b74-d3e9-416d-80a7-2450eac1a27c service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:26.446103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8b74-d3e9-416d-80a7-2450eac1a27c service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:26.446420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8b74-d3e9-416d-80a7-2450eac1a27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:26.455560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c8b74-d3e9-416d-80a7-2450eac1a27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:26.457049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c8b74-d3e9-416d-80a7-2450eac1a27c service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:26.466870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1096/2146] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:26 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:26.720099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3ed6-8f85-4c89-8790-959cf713c295 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:26.728276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d3ed6-8f85-4c89-8790-959cf713c295 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:26.733574 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ab949-5365-4ca4-976d-9b9629f217a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:26.734431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ab949-5365-4ca4-976d-9b9629f217a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:26.734959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ab949-5365-4ca4-976d-9b9629f217a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:26.735523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ab949-5365-4ca4-976d-9b9629f217a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:26.811826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ab949-5365-4ca4-976d-9b9629f217a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:26.819873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ab949-5365-4ca4-976d-9b9629f217a5 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:26.828225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1051/2147] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:26 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:27.162330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c8b74-d3e9-416d-80a7-2450eac1a27c service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:27.246331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c8b74-d3e9-416d-80a7-2450eac1a27c service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:27.251080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:27.252036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:27.252313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:27.252584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] PATH_INFO: `/v3/users/90adec7d9e644481846e4dfbe73d6352` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:27.253877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90adec7d9e644481846e4dfbe73d6352)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:27.255937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:27.483452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90adec7d9e644481846e4dfbe73d6352'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:27.484087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90adec7d9e644481846e4dfbe73d6352'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:27.484679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90adec7d9e644481846e4dfbe73d6352'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:27.629513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90adec7d9e644481846e4dfbe73d6352'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:27.643688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90adec7d9e644481846e4dfbe73d6352'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:27.656313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1097/2148] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:27 2021] DELETE /identity/v3/users/90adec7d9e644481846e4dfbe73d6352 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:27.661511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc4af-3c02-4e02-9720-27df25868e4a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:27.664647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc4af-3c02-4e02-9720-27df25868e4a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:27.664647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc4af-3c02-4e02-9720-27df25868e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:27.679121 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-89cfc4af-3c02-4e02-9720-27df25868e4a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:27.680335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-89cfc4af-3c02-4e02-9720-27df25868e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:27.738194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1052/2149] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:27.750145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:27.751822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:27.807691 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66b1f4-ba55-4eb5-9d09-5bd4b91a419c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:27.811207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef348d1a-c3a4-40e5-ac32-c8e5d61833c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:27.811837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef348d1a-c3a4-40e5-ac32-c8e5d61833c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:27.812111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef348d1a-c3a4-40e5-ac32-c8e5d61833c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:27.812424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef348d1a-c3a4-40e5-ac32-c8e5d61833c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:27.821225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef348d1a-c3a4-40e5-ac32-c8e5d61833c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:27.822848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef348d1a-c3a4-40e5-ac32-c8e5d61833c5 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:27.832092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1098/2150] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:28.247877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfc4af-3c02-4e02-9720-27df25868e4a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:28.249256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-89cfc4af-3c02-4e02-9720-27df25868e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:28.262642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfc4af-3c02-4e02-9720-27df25868e4a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:28.267187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:28.268036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:28.268308 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:28.268619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] PATH_INFO: `/v3/projects/b705ffdb92b94b20a00f6cf12b427ed4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:28.269795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b705ffdb92b94b20a00f6cf12b427ed4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:28.272547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:28.475236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b705ffdb92b94b20a00f6cf12b427ed4', 'request_id': 'req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.573070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b705ffdb92b94b20a00f6cf12b427ed4', 'request_id': 'req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.578988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b705ffdb92b94b20a00f6cf12b427ed4', 'request_id': 'req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.590357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] The token cache is being invalidate because project b705ffdb92b94b20a00f6cf12b427ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:28.590661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.591307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.592824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1053/2151] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:28 2021] DELETE /identity/v3/projects/b705ffdb92b94b20a00f6cf12b427ed4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:28.596792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef348d1a-c3a4-40e5-ac32-c8e5d61833c5 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:28.606432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef348d1a-c3a4-40e5-ac32-c8e5d61833c5 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:28.659775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:28.660635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:28.660916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:28.661188 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] PATH_INFO: `/v3/users/2b7cae4ad57a45f282f441d694d7d5f5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:28.662486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7cae4ad57a45f282f441d694d7d5f5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:28.664418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:28.865532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7cae4ad57a45f282f441d694d7d5f5'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.868011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7cae4ad57a45f282f441d694d7d5f5'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.868011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7cae4ad57a45f282f441d694d7d5f5'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.977906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7cae4ad57a45f282f441d694d7d5f5'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:28.990724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-af2b3564-d542-4e8a-82ea-2d380935de59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7cae4ad57a45f282f441d694d7d5f5'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:29.003639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1099/2152] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:28 2021] DELETE /identity/v3/users/2b7cae4ad57a45f282f441d694d7d5f5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:29.523387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:29.526384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:29.537868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc83dbd-34f1-4cf0-9638-9e926dcbf41f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:29.601027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:29.601890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:29.602173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:29.602445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] PATH_INFO: `/v3/projects/2cca5c92f2fd4818898a3c4ee58b0548` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:29.604428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cca5c92f2fd4818898a3c4ee58b0548)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:29.606325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:29.760099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cca5c92f2fd4818898a3c4ee58b0548', 'request_id': 'req-59960d01-2d09-4abd-99ca-fa07284d417f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:29.905119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cca5c92f2fd4818898a3c4ee58b0548', 'request_id': 'req-59960d01-2d09-4abd-99ca-fa07284d417f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:29.918687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cca5c92f2fd4818898a3c4ee58b0548', 'request_id': 'req-59960d01-2d09-4abd-99ca-fa07284d417f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:29.936985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] The token cache is being invalidate because project 2cca5c92f2fd4818898a3c4ee58b0548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:29.937618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:29.938390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-59960d01-2d09-4abd-99ca-fa07284d417f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:29.943353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1054/2153] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:29 2021] DELETE /identity/v3/projects/2cca5c92f2fd4818898a3c4ee58b0548 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:29.952118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4d0f-6876-4165-a1d5-70b91f0006d0 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:29.952577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4d0f-6876-4165-a1d5-70b91f0006d0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:29.952680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4d0f-6876-4165-a1d5-70b91f0006d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:29.989999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-468e4d0f-6876-4165-a1d5-70b91f0006d0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:29.991236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-468e4d0f-6876-4165-a1d5-70b91f0006d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:30.101748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1100/2154] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:30.103389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f1c5-eec8-435a-b0f9-477a24eb2db3 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.103708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f1c5-eec8-435a-b0f9-477a24eb2db3 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.104440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f1c5-eec8-435a-b0f9-477a24eb2db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.147243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e6f3f1c5-eec8-435a-b0f9-477a24eb2db3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:30.152740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e6f3f1c5-eec8-435a-b0f9-477a24eb2db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:30.177081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1055/2155] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:30.181314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e4d0f-6876-4165-a1d5-70b91f0006d0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:30.191976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e4d0f-6876-4165-a1d5-70b91f0006d0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:30.196985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:30.198283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.198734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.199058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.199901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:30.200312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:30.202093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:30.215382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1101/2156] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:30.219691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3f1c5-eec8-435a-b0f9-477a24eb2db3 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:30.232876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3f1c5-eec8-435a-b0f9-477a24eb2db3 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:30.239030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0bd0c-0172-403f-940e-b00d49525ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:30.239783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bd0c-0172-403f-940e-b00d49525ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.240060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bd0c-0172-403f-940e-b00d49525ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.240334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bd0c-0172-403f-940e-b00d49525ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.241045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0bd0c-0172-403f-940e-b00d49525ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:30.242989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0bd0c-0172-403f-940e-b00d49525ca1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:30.359859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:30.361536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:30.374838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5a40b-2c3a-4902-97f2-b1bb598d491b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:30.379756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:30.380618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.380895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.381204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] PATH_INFO: `/v3/users/096eda600717459693b0576a9ea0fe31` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.382391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096eda600717459693b0576a9ea0fe31)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:30.384330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:30.427214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1056/2157] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:30 2021] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:30.433203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0bd0c-0172-403f-940e-b00d49525ca1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:30.496262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0bd0c-0172-403f-940e-b00d49525ca1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:30.502755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f0f2a-7103-4eb5-933b-003eac3034b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:30.503459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0f2a-7103-4eb5-933b-003eac3034b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.503775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0f2a-7103-4eb5-933b-003eac3034b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.504009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0f2a-7103-4eb5-933b-003eac3034b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.504856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f0f2a-7103-4eb5-933b-003eac3034b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:30.507329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f0f2a-7103-4eb5-933b-003eac3034b8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:30.642405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1057/2158] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:30 2021] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:30.647100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f0f2a-7103-4eb5-933b-003eac3034b8 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:30.650399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096eda600717459693b0576a9ea0fe31'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:30.651357 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096eda600717459693b0576a9ea0fe31'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:30.652064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096eda600717459693b0576a9ea0fe31'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:30.656845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f0f2a-7103-4eb5-933b-003eac3034b8 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:30.663645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:30.664299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.664577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.664846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.665616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:30.667242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:30.677940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1058/2159] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:30.682449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:30.684372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:30.697999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7a217-0dd3-4312-8b33-f4639d6e6949 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:30.702753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54980429-9851-44f4-bade-0bd8f42acb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:30.703401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54980429-9851-44f4-bade-0bd8f42acb16 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.703681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54980429-9851-44f4-bade-0bd8f42acb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.703956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54980429-9851-44f4-bade-0bd8f42acb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.704674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54980429-9851-44f4-bade-0bd8f42acb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:30.706245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54980429-9851-44f4-bade-0bd8f42acb16 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:30.717204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1059/2160] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:30 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:30.721334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54980429-9851-44f4-bade-0bd8f42acb16 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:30.731049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54980429-9851-44f4-bade-0bd8f42acb16 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:30.735916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b4c4c-4be5-4872-b082-e3baa9207558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:30.736876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4c4c-4be5-4872-b082-e3baa9207558 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.737156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4c4c-4be5-4872-b082-e3baa9207558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.737451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b4c4c-4be5-4872-b082-e3baa9207558 admin admin] PATH_INFO: `/v3/projects/c15a08acc3184459970277000d93c9a9/users/bc4b1c4f6ed144e78cd2859235952e37/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.743708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096eda600717459693b0576a9ea0fe31'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:30.753065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b4c4c-4be5-4872-b082-e3baa9207558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15a08acc3184459970277000d93c9a9, user_id=bc4b1c4f6ed144e78cd2859235952e37, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:30.756206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b4c4c-4be5-4872-b082-e3baa9207558 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:30.764486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ed4e0810-8e6a-4bb5-8dd1-682694f27c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096eda600717459693b0576a9ea0fe31'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:30.778814 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1102/2161] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:30 2021] DELETE /identity/v3/users/096eda600717459693b0576a9ea0fe31 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:30.783089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8421-d4f0-42b2-8dac-015c93e99a53 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.783453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8421-d4f0-42b2-8dac-015c93e99a53 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.783793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8421-d4f0-42b2-8dac-015c93e99a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.803104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b00f8421-d4f0-42b2-8dac-015c93e99a53 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:30.806259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b00f8421-d4f0-42b2-8dac-015c93e99a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:30.835946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1060/2162] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:30 2021] PUT /identity/v3/projects/c15a08acc3184459970277000d93c9a9/users/bc4b1c4f6ed144e78cd2859235952e37/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:30.847909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f0c79-51c3-477b-8e7f-a27f5072f695 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:30.848398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f0c79-51c3-477b-8e7f-a27f5072f695 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:30.848847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f0c79-51c3-477b-8e7f-a27f5072f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:30.899898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-583f0c79-51c3-477b-8e7f-a27f5072f695 None None] MFA Rules not processed for user `bc4b1c4f6ed144e78cd2859235952e37`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:30.901170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-583f0c79-51c3-477b-8e7f-a27f5072f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:30.904026 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1103/2163] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:30.914304 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8421-d4f0-42b2-8dac-015c93e99a53 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:30.915704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b00f8421-d4f0-42b2-8dac-015c93e99a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:30.987362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8421-d4f0-42b2-8dac-015c93e99a53 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:30.988693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1061/2164] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:30 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:31.000104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f0c79-51c3-477b-8e7f-a27f5072f695 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:31.001748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-583f0c79-51c3-477b-8e7f-a27f5072f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:31.057932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdefcb-3488-4592-854f-90f648f5187b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:31.058807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdefcb-3488-4592-854f-90f648f5187b service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:31.059087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdefcb-3488-4592-854f-90f648f5187b service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:31.059361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdefcb-3488-4592-854f-90f648f5187b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:31.089876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f0c79-51c3-477b-8e7f-a27f5072f695 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:31.095384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3b916-4d76-4e13-a82e-fbec9468d324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:31.098104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b916-4d76-4e13-a82e-fbec9468d324 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:31.098474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b916-4d76-4e13-a82e-fbec9468d324 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:31.098838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3b916-4d76-4e13-a82e-fbec9468d324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:31.127300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3b916-4d76-4e13-a82e-fbec9468d324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:31.127300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3b916-4d76-4e13-a82e-fbec9468d324 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:31.138470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1062/2165] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:30 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:31.159940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3b916-4d76-4e13-a82e-fbec9468d324 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:31.168842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdefcb-3488-4592-854f-90f648f5187b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:31.170464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdefcb-3488-4592-854f-90f648f5187b service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:31.175141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3b916-4d76-4e13-a82e-fbec9468d324 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:31.181260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1104/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:31.182890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:31.183901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:31.184181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:31.184450 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] PATH_INFO: `/v3/users/bc4b1c4f6ed144e78cd2859235952e37` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:31.185742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4b1c4f6ed144e78cd2859235952e37)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:31.188288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:31.444631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4b1c4f6ed144e78cd2859235952e37'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.445430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4b1c4f6ed144e78cd2859235952e37'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.446088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4b1c4f6ed144e78cd2859235952e37'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.538977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4b1c4f6ed144e78cd2859235952e37'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.556468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4b1c4f6ed144e78cd2859235952e37'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.571449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1063/2167] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:31 2021] DELETE /identity/v3/users/bc4b1c4f6ed144e78cd2859235952e37 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:31.576613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8dde5-00ce-47f8-82bc-7a15087c9a0c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:31.576904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8dde5-00ce-47f8-82bc-7a15087c9a0c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:31.577178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8dde5-00ce-47f8-82bc-7a15087c9a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:31.595329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c0b8dde5-00ce-47f8-82bc-7a15087c9a0c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:31.596554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c0b8dde5-00ce-47f8-82bc-7a15087c9a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:31.674575 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1105/2168] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:31.684356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:31.685883 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:31.703391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8dde5-00ce-47f8-82bc-7a15087c9a0c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:31.705068 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c0b8dde5-00ce-47f8-82bc-7a15087c9a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:31.718311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8dde5-00ce-47f8-82bc-7a15087c9a0c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:31.729299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:31.729632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:31.729846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:31.730133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] PATH_INFO: `/v3/projects/2fb389bd85d14905b8fb1a86aa955154` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:31.732149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb389bd85d14905b8fb1a86aa955154)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:31.734060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:31.757295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df0c24-50cb-4bef-86aa-b09c49994692 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:31.761771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900661b-0fdc-4373-b543-94d5a0788fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:31.762459 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900661b-0fdc-4373-b543-94d5a0788fde service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:31.762773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900661b-0fdc-4373-b543-94d5a0788fde service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:31.763083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900661b-0fdc-4373-b543-94d5a0788fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:31.772105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900661b-0fdc-4373-b543-94d5a0788fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:31.773524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900661b-0fdc-4373-b543-94d5a0788fde service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:31.783481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1064/2169] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:31.886476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb389bd85d14905b8fb1a86aa955154', 'request_id': 'req-85a28953-e163-4373-978e-887c7c7de7b3'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.972490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb389bd85d14905b8fb1a86aa955154', 'request_id': 'req-85a28953-e163-4373-978e-887c7c7de7b3'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.979941 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb389bd85d14905b8fb1a86aa955154', 'request_id': 'req-85a28953-e163-4373-978e-887c7c7de7b3'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.991576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] The token cache is being invalidate because project 2fb389bd85d14905b8fb1a86aa955154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:31.992201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.992711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:31.994377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1106/2170] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:31 2021] DELETE /identity/v3/projects/2fb389bd85d14905b8fb1a86aa955154 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:31.998407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900661b-0fdc-4373-b543-94d5a0788fde service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:32.008420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900661b-0fdc-4373-b543-94d5a0788fde service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:32.084669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:32.084669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:32.085007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:32.085171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] PATH_INFO: `/v3/users/a5c914a2c1d5445cb3c19c2ad61eb2e1` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:32.086557 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c914a2c1d5445cb3c19c2ad61eb2e1)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:32.089132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:32.311825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:32.313256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:32.326928 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28953-e163-4373-978e-887c7c7de7b3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:32.331481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:32.332351 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:32.332637 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:32.332912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] PATH_INFO: `/v3/users/2b16648a55ee47adb2f0a0766d48a9f8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:32.334170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b16648a55ee47adb2f0a0766d48a9f8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:32.336109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:32.436084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c914a2c1d5445cb3c19c2ad61eb2e1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.437298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c914a2c1d5445cb3c19c2ad61eb2e1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.437588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c914a2c1d5445cb3c19c2ad61eb2e1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.526829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c914a2c1d5445cb3c19c2ad61eb2e1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.544442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c914a2c1d5445cb3c19c2ad61eb2e1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.552029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1065/2171] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:31 2021] DELETE /identity/v3/users/a5c914a2c1d5445cb3c19c2ad61eb2e1 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:32.552813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:32.554127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:32.577107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b16648a55ee47adb2f0a0766d48a9f8'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.577887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b16648a55ee47adb2f0a0766d48a9f8'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.578893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b16648a55ee47adb2f0a0766d48a9f8'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.637061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b16648a55ee47adb2f0a0766d48a9f8'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.637625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e871-25df-4691-86ad-c31cb4c4364f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:32.643822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:32.644782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:32.645171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:32.645544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] PATH_INFO: `/v3/projects/c15a08acc3184459970277000d93c9a9` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:32.646994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15a08acc3184459970277000d93c9a9)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:32.649316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:32.658100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2fe9ee83-44c6-485b-9533-14c90cfa8427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b16648a55ee47adb2f0a0766d48a9f8'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.691783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1107/2172] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:32 2021] DELETE /identity/v3/users/2b16648a55ee47adb2f0a0766d48a9f8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:32.806528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15a08acc3184459970277000d93c9a9', 'request_id': 'req-098a049e-7702-4ce9-955e-0d7c64c14e85'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.921322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15a08acc3184459970277000d93c9a9', 'request_id': 'req-098a049e-7702-4ce9-955e-0d7c64c14e85'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.927243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15a08acc3184459970277000d93c9a9', 'request_id': 'req-098a049e-7702-4ce9-955e-0d7c64c14e85'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.939536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] The token cache is being invalidate because project c15a08acc3184459970277000d93c9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:32.939955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.940722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:32.942497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1066/2173] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:32 2021] DELETE /identity/v3/projects/c15a08acc3184459970277000d93c9a9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:32.948398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a045c1-4081-47ce-b800-8a8ac2bc842e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:32.948784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a045c1-4081-47ce-b800-8a8ac2bc842e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:32.949120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a045c1-4081-47ce-b800-8a8ac2bc842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:32.968414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a6a045c1-4081-47ce-b800-8a8ac2bc842e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:32.969617 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a6a045c1-4081-47ce-b800-8a8ac2bc842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.008904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.011002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.042324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1108/2174] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:33.043749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a045c1-4081-47ce-b800-8a8ac2bc842e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.050912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a6a045c1-4081-47ce-b800-8a8ac2bc842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.065306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a045c1-4081-47ce-b800-8a8ac2bc842e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.071177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.072815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.073180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.073590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] PATH_INFO: `/v3/projects/ca5ef15dfcf040978a77e5cee0b58952` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.075042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca5ef15dfcf040978a77e5cee0b58952)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.077024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.094162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a049e-7702-4ce9-955e-0d7c64c14e85 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.098945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.100022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.100375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.100714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] PATH_INFO: `/v3/projects/62e88ea9868543be9ea642bd11db4961` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.102050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e88ea9868543be9ea642bd11db4961)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.104422 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.183839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5ef15dfcf040978a77e5cee0b58952', 'request_id': 'req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.212671 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e88ea9868543be9ea642bd11db4961', 'request_id': 'req-af98e590-ce67-4ae7-8209-e52e3d66a933'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.246550 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5ef15dfcf040978a77e5cee0b58952', 'request_id': 'req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.252380 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5ef15dfcf040978a77e5cee0b58952', 'request_id': 'req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.263756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] The token cache is being invalidate because project ca5ef15dfcf040978a77e5cee0b58952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:33.264043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.264691 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-7e77013a-69fc-4d61-a9c7-c67dc09cf8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.266228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1109/2175] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:33 2021] DELETE /identity/v3/projects/ca5ef15dfcf040978a77e5cee0b58952 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:33.267493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a94b-c6ed-4f7d-a770-edeed253e3c0 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.267777 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a94b-c6ed-4f7d-a770-edeed253e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.268054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a94b-c6ed-4f7d-a770-edeed253e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.286233 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3d60a94b-c6ed-4f7d-a770-edeed253e3c0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:33.287445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3d60a94b-c6ed-4f7d-a770-edeed253e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.298435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e88ea9868543be9ea642bd11db4961', 'request_id': 'req-af98e590-ce67-4ae7-8209-e52e3d66a933'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.304425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e88ea9868543be9ea642bd11db4961', 'request_id': 'req-af98e590-ce67-4ae7-8209-e52e3d66a933'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.315555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] The token cache is being invalidate because project 62e88ea9868543be9ea642bd11db4961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:33.315845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.316529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-af98e590-ce67-4ae7-8209-e52e3d66a933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.321332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1067/2176] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:33 2021] DELETE /identity/v3/projects/62e88ea9868543be9ea642bd11db4961 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:33.321332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5138-3591-4d70-ac0c-0d6a1d9ee9d7 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.321332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5138-3591-4d70-ac0c-0d6a1d9ee9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.321332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f5138-3591-4d70-ac0c-0d6a1d9ee9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.339433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-761f5138-3591-4d70-ac0c-0d6a1d9ee9d7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:33.340630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-761f5138-3591-4d70-ac0c-0d6a1d9ee9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.345855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1110/2177] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:33.346787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a94b-c6ed-4f7d-a770-edeed253e3c0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.348045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3d60a94b-c6ed-4f7d-a770-edeed253e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.348809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1068/2178] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:33.351423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f5138-3591-4d70-ac0c-0d6a1d9ee9d7 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.360073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a94b-c6ed-4f7d-a770-edeed253e3c0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.360942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f5138-3591-4d70-ac0c-0d6a1d9ee9d7 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.364929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.365785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c46ec4-bab1-4dec-903d-31e9260a040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.365914 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.366118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.366385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] PATH_INFO: `/v3/users/b588b4c1bb6d413589059eeec1515a6f` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.366496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c46ec4-bab1-4dec-903d-31e9260a040e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.366728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c46ec4-bab1-4dec-903d-31e9260a040e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.367004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c46ec4-bab1-4dec-903d-31e9260a040e admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.367629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b588b4c1bb6d413589059eeec1515a6f)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.367748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c46ec4-bab1-4dec-903d-31e9260a040e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:33.368019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c46ec4-bab1-4dec-903d-31e9260a040e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.369631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.369737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c46ec4-bab1-4dec-903d-31e9260a040e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.385978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1069/2179] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:15:33.387587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18881-285e-425f-a1ca-67542e10df4a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.387968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18881-285e-425f-a1ca-67542e10df4a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.388358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18881-285e-425f-a1ca-67542e10df4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.408027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9ee18881-285e-425f-a1ca-67542e10df4a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:33.409221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9ee18881-285e-425f-a1ca-67542e10df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.417139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1070/2180] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:33.418026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18881-285e-425f-a1ca-67542e10df4a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.427284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18881-285e-425f-a1ca-67542e10df4a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.432666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db5789-98ce-4fa8-bbeb-54adb1f3681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.433321 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db5789-98ce-4fa8-bbeb-54adb1f3681d admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.437502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db5789-98ce-4fa8-bbeb-54adb1f3681d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.437502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db5789-98ce-4fa8-bbeb-54adb1f3681d admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.437502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db5789-98ce-4fa8-bbeb-54adb1f3681d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.437502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db5789-98ce-4fa8-bbeb-54adb1f3681d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.580175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1071/2181] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:33 2021] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:33.581006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db5789-98ce-4fa8-bbeb-54adb1f3681d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.644155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db5789-98ce-4fa8-bbeb-54adb1f3681d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.645205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b588b4c1bb6d413589059eeec1515a6f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.645796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b588b4c1bb6d413589059eeec1515a6f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.646680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b588b4c1bb6d413589059eeec1515a6f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.649117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.649774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.650049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.650354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.651271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:33.651577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.653165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.664804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1072/2182] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:33.665686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.669348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.682249 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c77441-bdbd-431d-ac3b-82d44490d849 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.687952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929a2a5-acca-426f-b521-7e7f14b5e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.688559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a2a5-acca-426f-b521-7e7f14b5e36b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.688828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a2a5-acca-426f-b521-7e7f14b5e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.689102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a2a5-acca-426f-b521-7e7f14b5e36b admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.689806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929a2a5-acca-426f-b521-7e7f14b5e36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.691811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929a2a5-acca-426f-b521-7e7f14b5e36b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.731997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b588b4c1bb6d413589059eeec1515a6f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.744695 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b588b4c1bb6d413589059eeec1515a6f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:33.756656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1111/2183] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:33 2021] DELETE /identity/v3/users/b588b4c1bb6d413589059eeec1515a6f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:33.757424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.758773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:33.825591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1073/2184] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:33 2021] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:33.829519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929a2a5-acca-426f-b521-7e7f14b5e36b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.835201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd2e66-d833-408e-9fed-83d8c34346e3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.840399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb95c3-d538-47b7-82c4-4dd38d65662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.841423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb95c3-d538-47b7-82c4-4dd38d65662f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.841810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb95c3-d538-47b7-82c4-4dd38d65662f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.842098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb95c3-d538-47b7-82c4-4dd38d65662f admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.842842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb95c3-d538-47b7-82c4-4dd38d65662f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.844767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb95c3-d538-47b7-82c4-4dd38d65662f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.845498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929a2a5-acca-426f-b521-7e7f14b5e36b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.854214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2bbf1-0bad-4beb-a322-62ca07e4af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.855162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bbf1-0bad-4beb-a322-62ca07e4af20 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.855542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bbf1-0bad-4beb-a322-62ca07e4af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.855784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bbf1-0bad-4beb-a322-62ca07e4af20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.856754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2bbf1-0bad-4beb-a322-62ca07e4af20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.858621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2bbf1-0bad-4beb-a322-62ca07e4af20 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.870894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1074/2185] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:33 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:33.874992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2bbf1-0bad-4beb-a322-62ca07e4af20 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.885427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2bbf1-0bad-4beb-a322-62ca07e4af20 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.890282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f13f7-64fc-4212-baaf-7ae9e566569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.891081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f13f7-64fc-4212-baaf-7ae9e566569f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.891360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f13f7-64fc-4212-baaf-7ae9e566569f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.891631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f13f7-64fc-4212-baaf-7ae9e566569f admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.892387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f13f7-64fc-4212-baaf-7ae9e566569f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.893963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f13f7-64fc-4212-baaf-7ae9e566569f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.907776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1075/2186] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:33.909011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f13f7-64fc-4212-baaf-7ae9e566569f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:33.919744 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f13f7-64fc-4212-baaf-7ae9e566569f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:33.924978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:33.925855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:33.926131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:33.926403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] PATH_INFO: `/v3/projects/3bff428ab3b4496183f70fe549dc36f3/users/055ab73a1642467c96847e99ed9f7487/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:33.941165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1112/2187] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:33 2021] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:33.941349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bff428ab3b4496183f70fe549dc36f3, user_id=055ab73a1642467c96847e99ed9f7487, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:33.944246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:33.945242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb95c3-d538-47b7-82c4-4dd38d65662f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.005389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb95c3-d538-47b7-82c4-4dd38d65662f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.010566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981dfd-8ab4-4b0f-b963-b32a624ab46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.011254 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981dfd-8ab4-4b0f-b963-b32a624ab46a admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.011547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981dfd-8ab4-4b0f-b963-b32a624ab46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.011805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981dfd-8ab4-4b0f-b963-b32a624ab46a admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.012543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981dfd-8ab4-4b0f-b963-b32a624ab46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.014435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981dfd-8ab4-4b0f-b963-b32a624ab46a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.076980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1076/2188] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:33 2021] PUT /identity/v3/projects/3bff428ab3b4496183f70fe549dc36f3/users/055ab73a1642467c96847e99ed9f7487/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:34.077808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.079559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:34.141591 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d29b8-ac0f-4af4-a956-d5e8894676c2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.146881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1113/2189] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:33 2021] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:34.146881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34f83-2100-4187-a0e5-627081f350d4 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.146881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34f83-2100-4187-a0e5-627081f350d4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.146881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34f83-2100-4187-a0e5-627081f350d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.147640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.147640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.147640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.148127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] PATH_INFO: `/v3/projects/e76706615e434c6083c33022dc1a2a93` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.148998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76706615e434c6083c33022dc1a2a93)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.151547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.174082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b0e34f83-2100-4187-a0e5-627081f350d4 None None] MFA Rules not processed for user `055ab73a1642467c96847e99ed9f7487`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:34.175384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b0e34f83-2100-4187-a0e5-627081f350d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:34.239109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1114/2190] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:34 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:34.239860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e34f83-2100-4187-a0e5-627081f350d4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.250246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e34f83-2100-4187-a0e5-627081f350d4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.254992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f4e0-d453-46fd-9d53-50d0efedd0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.255628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f4e0-d453-46fd-9d53-50d0efedd0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.255908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f4e0-d453-46fd-9d53-50d0efedd0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.256174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269f4e0-d453-46fd-9d53-50d0efedd0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.257274 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269f4e0-d453-46fd-9d53-50d0efedd0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.260676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269f4e0-d453-46fd-9d53-50d0efedd0a4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.276682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1115/2191] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:34.277981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f4e0-d453-46fd-9d53-50d0efedd0a4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.282204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76706615e434c6083c33022dc1a2a93', 'request_id': 'req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:34.288743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269f4e0-d453-46fd-9d53-50d0efedd0a4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.342736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad1e9-d0a1-420c-b2c6-dae0ae2f4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.343389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad1e9-d0a1-420c-b2c6-dae0ae2f4066 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.343664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad1e9-d0a1-420c-b2c6-dae0ae2f4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.343933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad1e9-d0a1-420c-b2c6-dae0ae2f4066 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.344613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad1e9-d0a1-420c-b2c6-dae0ae2f4066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.346483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad1e9-d0a1-420c-b2c6-dae0ae2f4066 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.389222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76706615e434c6083c33022dc1a2a93', 'request_id': 'req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:34.395334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76706615e434c6083c33022dc1a2a93', 'request_id': 'req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:34.406407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] The token cache is being invalidate because project e76706615e434c6083c33022dc1a2a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:34.406716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:34.407372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:34.408889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1077/2192] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:34 2021] DELETE /identity/v3/projects/e76706615e434c6083c33022dc1a2a93 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:34.409627 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.410923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:34.422853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc4b2-7ed8-4634-9805-d41c9c5b03e5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.427670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ce6ed-9002-478c-9bf2-c44e4b3db20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.428310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce6ed-9002-478c-9bf2-c44e4b3db20d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.428584 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce6ed-9002-478c-9bf2-c44e4b3db20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.428854 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce6ed-9002-478c-9bf2-c44e4b3db20d admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.429580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ce6ed-9002-478c-9bf2-c44e4b3db20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.431275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ce6ed-9002-478c-9bf2-c44e4b3db20d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.441701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1078/2193] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:34.442963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95492-d3ac-41e3-887c-c4cab765a6f2 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.443253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95492-d3ac-41e3-887c-c4cab765a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.443529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb95492-d3ac-41e3-887c-c4cab765a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.461423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1bb95492-d3ac-41e3-887c-c4cab765a6f2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:34.462635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1bb95492-d3ac-41e3-887c-c4cab765a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:34.470445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1079/2194] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:34.471193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95492-d3ac-41e3-887c-c4cab765a6f2 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.482485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb95492-d3ac-41e3-887c-c4cab765a6f2 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.487763 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b76a1-24db-4595-bf6d-2228ab7a55d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.488685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b76a1-24db-4595-bf6d-2228ab7a55d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.488789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1116/2195] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:34 2021] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:34.490345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dad60-3ee7-4101-b828-72364a8079c3 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.490704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dad60-3ee7-4101-b828-72364a8079c3 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.491059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dad60-3ee7-4101-b828-72364a8079c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.491204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b76a1-24db-4595-bf6d-2228ab7a55d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.491723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b76a1-24db-4595-bf6d-2228ab7a55d7 admin admin] PATH_INFO: `/v3/projects/cc04429abe7547a092e4a3147034fbc7/users/95d912a459df4fc59387ed9be12fb6b9/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.514031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dd9dad60-3ee7-4101-b828-72364a8079c3 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:34.514125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b76a1-24db-4595-bf6d-2228ab7a55d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc04429abe7547a092e4a3147034fbc7, user_id=95d912a459df4fc59387ed9be12fb6b9, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.514205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dd9dad60-3ee7-4101-b828-72364a8079c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:34.516269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b76a1-24db-4595-bf6d-2228ab7a55d7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.571672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1117/2196] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:34.573046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dad60-3ee7-4101-b828-72364a8079c3 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.574281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dd9dad60-3ee7-4101-b828-72364a8079c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:34.585407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dad60-3ee7-4101-b828-72364a8079c3 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.589972 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae0b1-0f50-4186-9dc2-ecc8d36d2109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.590641 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae0b1-0f50-4186-9dc2-ecc8d36d2109 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.590920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae0b1-0f50-4186-9dc2-ecc8d36d2109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.591189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae0b1-0f50-4186-9dc2-ecc8d36d2109 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.591870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcae0b1-0f50-4186-9dc2-ecc8d36d2109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.593936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcae0b1-0f50-4186-9dc2-ecc8d36d2109 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.664463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1080/2197] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:34 2021] PUT /identity/v3/projects/cc04429abe7547a092e4a3147034fbc7/users/95d912a459df4fc59387ed9be12fb6b9/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:34.665481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b76a1-24db-4595-bf6d-2228ab7a55d7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.724257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b76a1-24db-4595-bf6d-2228ab7a55d7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.729728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5e737-11fe-4ea8-8f2d-ae716c925fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.730660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5e737-11fe-4ea8-8f2d-ae716c925fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.730802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5e737-11fe-4ea8-8f2d-ae716c925fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.731023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5e737-11fe-4ea8-8f2d-ae716c925fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.731766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5e737-11fe-4ea8-8f2d-ae716c925fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:34.732070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5e737-11fe-4ea8-8f2d-ae716c925fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.733631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5e737-11fe-4ea8-8f2d-ae716c925fe3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.745931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1081/2198] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:34.747354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cc5a-8bc6-4bf3-9c7a-bb822f35d0b4 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.747641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cc5a-8bc6-4bf3-9c7a-bb822f35d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.747916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168cc5a-8bc6-4bf3-9c7a-bb822f35d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.778117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-0168cc5a-8bc6-4bf3-9c7a-bb822f35d0b4 None None] MFA Rules not processed for user `95d912a459df4fc59387ed9be12fb6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:34.779553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0168cc5a-8bc6-4bf3-9c7a-bb822f35d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:34.797366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1118/2199] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:34 2021] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:34.798640 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae0b1-0f50-4186-9dc2-ecc8d36d2109 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.824749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae0b1-0f50-4186-9dc2-ecc8d36d2109 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.836513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903ac14-8b2e-4f74-a58e-db24c6b19afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.837179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ac14-8b2e-4f74-a58e-db24c6b19afa admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.837457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ac14-8b2e-4f74-a58e-db24c6b19afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.837724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ac14-8b2e-4f74-a58e-db24c6b19afa admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.841372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903ac14-8b2e-4f74-a58e-db24c6b19afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.846415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903ac14-8b2e-4f74-a58e-db24c6b19afa admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.882741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1082/2200] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:34 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:34.884609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168cc5a-8bc6-4bf3-9c7a-bb822f35d0b4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.899863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168cc5a-8bc6-4bf3-9c7a-bb822f35d0b4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.911301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c48879-0e62-4927-bdd4-e30322ffd6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.912243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c48879-0e62-4927-bdd4-e30322ffd6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.912519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c48879-0e62-4927-bdd4-e30322ffd6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.912868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c48879-0e62-4927-bdd4-e30322ffd6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.913686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c48879-0e62-4927-bdd4-e30322ffd6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.915310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c48879-0e62-4927-bdd4-e30322ffd6f2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.926642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1083/2201] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:34.926642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c48879-0e62-4927-bdd4-e30322ffd6f2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:34.936222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c48879-0e62-4927-bdd4-e30322ffd6f2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:34.940906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abf103-b453-49d3-8a8d-bed5dda6f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:34.941544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf103-b453-49d3-8a8d-bed5dda6f6ee admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:34.941825 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf103-b453-49d3-8a8d-bed5dda6f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:34.942100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf103-b453-49d3-8a8d-bed5dda6f6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:34.942852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abf103-b453-49d3-8a8d-bed5dda6f6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:34.944849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abf103-b453-49d3-8a8d-bed5dda6f6ee admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:34.990564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1119/2202] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:34 2021] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:34.991388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903ac14-8b2e-4f74-a58e-db24c6b19afa admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.052213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903ac14-8b2e-4f74-a58e-db24c6b19afa admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.062581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4bdcf-99f2-44aa-90ca-ad67adbef1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.062581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4bdcf-99f2-44aa-90ca-ad67adbef1dd admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.062581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4bdcf-99f2-44aa-90ca-ad67adbef1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.062581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4bdcf-99f2-44aa-90ca-ad67adbef1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.062911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4bdcf-99f2-44aa-90ca-ad67adbef1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.062911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4bdcf-99f2-44aa-90ca-ad67adbef1dd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.074976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1120/2203] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:35.075178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1084/2204] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:34 2021] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:35.075274 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4bdcf-99f2-44aa-90ca-ad67adbef1dd admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.076272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abf103-b453-49d3-8a8d-bed5dda6f6ee admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.083416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4bdcf-99f2-44aa-90ca-ad67adbef1dd admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.137178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abf103-b453-49d3-8a8d-bed5dda6f6ee admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.139858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04433e6-8a5e-44e2-86c7-4972e5c0e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.140524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04433e6-8a5e-44e2-86c7-4972e5c0e3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.140817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04433e6-8a5e-44e2-86c7-4972e5c0e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.141069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04433e6-8a5e-44e2-86c7-4972e5c0e3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.141759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04433e6-8a5e-44e2-86c7-4972e5c0e3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.141928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ea1a-cd9a-44ae-a292-58a84b37d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.142844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ea1a-cd9a-44ae-a292-58a84b37d498 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.143125 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ea1a-cd9a-44ae-a292-58a84b37d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.143402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ea1a-cd9a-44ae-a292-58a84b37d498 admin admin] PATH_INFO: `/v3/projects/9fdbd111608f404eba427ac74dff84d4/users/db4ae46e3e3f463e8957ba6f1d03be67/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.143687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04433e6-8a5e-44e2-86c7-4972e5c0e3e8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.158016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34ea1a-cd9a-44ae-a292-58a84b37d498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdbd111608f404eba427ac74dff84d4, user_id=db4ae46e3e3f463e8957ba6f1d03be67, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.163549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34ea1a-cd9a-44ae-a292-58a84b37d498 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.258164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1121/2205] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:35 2021] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:35.258909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04433e6-8a5e-44e2-86c7-4972e5c0e3e8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.268865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04433e6-8a5e-44e2-86c7-4972e5c0e3e8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.273389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec9c8-c4ee-4b20-9243-9bbd8adf1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.274017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec9c8-c4ee-4b20-9243-9bbd8adf1273 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.274294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec9c8-c4ee-4b20-9243-9bbd8adf1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.274582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec9c8-c4ee-4b20-9243-9bbd8adf1273 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.275259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec9c8-c4ee-4b20-9243-9bbd8adf1273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.277125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec9c8-c4ee-4b20-9243-9bbd8adf1273 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.289563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1085/2206] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:35 2021] PUT /identity/v3/projects/9fdbd111608f404eba427ac74dff84d4/users/db4ae46e3e3f463e8957ba6f1d03be67/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:35.289563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ea1a-cd9a-44ae-a292-58a84b37d498 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.349625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ea1a-cd9a-44ae-a292-58a84b37d498 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.355083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb9d19-93cd-49b5-b389-cf12cff85dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.355734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb9d19-93cd-49b5-b389-cf12cff85dde admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.356012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb9d19-93cd-49b5-b389-cf12cff85dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.356282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb9d19-93cd-49b5-b389-cf12cff85dde admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.357008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb9d19-93cd-49b5-b389-cf12cff85dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.358665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb9d19-93cd-49b5-b389-cf12cff85dde admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.368336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1086/2207] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:35.369910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3cc4-e27b-47f1-9aaf-dcd44554d43a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.370194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3cc4-e27b-47f1-9aaf-dcd44554d43a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.370463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3cc4-e27b-47f1-9aaf-dcd44554d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.373579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1122/2208] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:35 2021] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:35.374063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec9c8-c4ee-4b20-9243-9bbd8adf1273 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.383918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec9c8-c4ee-4b20-9243-9bbd8adf1273 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.388612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181707d-0c17-4e6a-9930-d5da3cbec185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.389260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181707d-0c17-4e6a-9930-d5da3cbec185 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.389545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181707d-0c17-4e6a-9930-d5da3cbec185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.389815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181707d-0c17-4e6a-9930-d5da3cbec185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.390612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181707d-0c17-4e6a-9930-d5da3cbec185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.392222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181707d-0c17-4e6a-9930-d5da3cbec185 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.397182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-abec3cc4-e27b-47f1-9aaf-dcd44554d43a None None] MFA Rules not processed for user `db4ae46e3e3f463e8957ba6f1d03be67`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:35.398448 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-abec3cc4-e27b-47f1-9aaf-dcd44554d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:35.403192 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1123/2209] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:35.404024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181707d-0c17-4e6a-9930-d5da3cbec185 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.415378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181707d-0c17-4e6a-9930-d5da3cbec185 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.420611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277a190-1392-4770-bbc5-8527364d8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.421258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a190-1392-4770-bbc5-8527364d8093 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.421538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a190-1392-4770-bbc5-8527364d8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.421857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277a190-1392-4770-bbc5-8527364d8093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.422598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277a190-1392-4770-bbc5-8527364d8093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.424190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277a190-1392-4770-bbc5-8527364d8093 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.435211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1124/2210] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:35.435986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277a190-1392-4770-bbc5-8527364d8093 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.445572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277a190-1392-4770-bbc5-8527364d8093 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.450237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2c98a-e524-4837-b1e2-e8292bd4e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.451216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2c98a-e524-4837-b1e2-e8292bd4e5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.451494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2c98a-e524-4837-b1e2-e8292bd4e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.451755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2c98a-e524-4837-b1e2-e8292bd4e5cc admin admin] PATH_INFO: `/v3/projects/715654fb99884e569362f92c5db2b61a/users/dcc15198eff24ea999cb55f8d6655cb9/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.465940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1087/2211] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:35 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:35.465940 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3cc4-e27b-47f1-9aaf-dcd44554d43a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.469608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2c98a-e524-4837-b1e2-e8292bd4e5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=715654fb99884e569362f92c5db2b61a, user_id=dcc15198eff24ea999cb55f8d6655cb9, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.472568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2c98a-e524-4837-b1e2-e8292bd4e5cc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.473241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3cc4-e27b-47f1-9aaf-dcd44554d43a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.477728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc5a49-f10e-4f60-b1ae-849d6346aaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.479500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5a49-f10e-4f60-b1ae-849d6346aaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.479688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5a49-f10e-4f60-b1ae-849d6346aaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.479959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc5a49-f10e-4f60-b1ae-849d6346aaa2 admin admin] PATH_INFO: `/v3/projects/ee984ee1cf584ea48589ccde4b70eba1/users/6939270a837f4e8a99980c297a338908/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.495171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc5a49-f10e-4f60-b1ae-849d6346aaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee984ee1cf584ea48589ccde4b70eba1, user_id=6939270a837f4e8a99980c297a338908, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.497868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc5a49-f10e-4f60-b1ae-849d6346aaa2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.551770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1125/2212] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:35 2021] PUT /identity/v3/projects/715654fb99884e569362f92c5db2b61a/users/dcc15198eff24ea999cb55f8d6655cb9/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:35.551770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2c98a-e524-4837-b1e2-e8292bd4e5cc admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.578271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1088/2213] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:35 2021] PUT /identity/v3/projects/ee984ee1cf584ea48589ccde4b70eba1/users/6939270a837f4e8a99980c297a338908/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:35.579690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad8a64-75d7-4b8c-b56e-f3b1d18cb43d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.579969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad8a64-75d7-4b8c-b56e-f3b1d18cb43d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.581991 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad8a64-75d7-4b8c-b56e-f3b1d18cb43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.608210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-3dad8a64-75d7-4b8c-b56e-f3b1d18cb43d None None] MFA Rules not processed for user `dcc15198eff24ea999cb55f8d6655cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:35.609432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3dad8a64-75d7-4b8c-b56e-f3b1d18cb43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:35.612120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2c98a-e524-4837-b1e2-e8292bd4e5cc admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.665421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca7566-32bb-4154-8aa7-09ca98669c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.666676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7566-32bb-4154-8aa7-09ca98669c58 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.666974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7566-32bb-4154-8aa7-09ca98669c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.667248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7566-32bb-4154-8aa7-09ca98669c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.668008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca7566-32bb-4154-8aa7-09ca98669c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.669956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca7566-32bb-4154-8aa7-09ca98669c58 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.671999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1089/2214] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:35.675586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad8a64-75d7-4b8c-b56e-f3b1d18cb43d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.686792 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad8a64-75d7-4b8c-b56e-f3b1d18cb43d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.691331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.691985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.692267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.692543 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.693280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.694909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.704967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1090/2215] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:35.705806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.707399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:35.760966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ddfe7-1ac0-4d91-b983-52bb6b676dc1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.764521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453394ed-d2dc-4ac1-a1ed-a4e659474866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.765149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453394ed-d2dc-4ac1-a1ed-a4e659474866 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.765425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453394ed-d2dc-4ac1-a1ed-a4e659474866 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.765696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453394ed-d2dc-4ac1-a1ed-a4e659474866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.773772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453394ed-d2dc-4ac1-a1ed-a4e659474866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.775209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453394ed-d2dc-4ac1-a1ed-a4e659474866 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.784162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1091/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:35 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:35.784970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453394ed-d2dc-4ac1-a1ed-a4e659474866 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.788329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1126/2217] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:35 2021] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:35.789981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca7566-32bb-4154-8aa7-09ca98669c58 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.795895 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453394ed-d2dc-4ac1-a1ed-a4e659474866 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.851933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca7566-32bb-4154-8aa7-09ca98669c58 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.856085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed21ed7-267a-40ab-bb6f-0144ea31e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.857155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed21ed7-267a-40ab-bb6f-0144ea31e5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.857547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed21ed7-267a-40ab-bb6f-0144ea31e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.857645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b261-0b87-459d-aaee-a1aa1b03a684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:35.857993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed21ed7-267a-40ab-bb6f-0144ea31e5e8 admin admin] PATH_INFO: `/v3/projects/ee984ee1cf584ea48589ccde4b70eba1/users/6939270a837f4e8a99980c297a338908/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.858300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b261-0b87-459d-aaee-a1aa1b03a684 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.858605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b261-0b87-459d-aaee-a1aa1b03a684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.858881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b261-0b87-459d-aaee-a1aa1b03a684 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.859691 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6b261-0b87-459d-aaee-a1aa1b03a684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.860484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed21ed7-267a-40ab-bb6f-0144ea31e5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee984ee1cf584ea48589ccde4b70eba1, user_id=6939270a837f4e8a99980c297a338908, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:35.861534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6b261-0b87-459d-aaee-a1aa1b03a684 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.863998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed21ed7-267a-40ab-bb6f-0144ea31e5e8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:35.875980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1092/2218] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:35 2021] PUT /identity/v3/projects/ee984ee1cf584ea48589ccde4b70eba1/users/6939270a837f4e8a99980c297a338908/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:35.890079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3306cd-d2fb-4105-8b7a-0401de6aeca1 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:35.890708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3306cd-d2fb-4105-8b7a-0401de6aeca1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:35.890708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3306cd-d2fb-4105-8b7a-0401de6aeca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:35.919127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7c3306cd-d2fb-4105-8b7a-0401de6aeca1 None None] MFA Rules not processed for user `6939270a837f4e8a99980c297a338908`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:35.920446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7c3306cd-d2fb-4105-8b7a-0401de6aeca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:35.980221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1127/2219] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:35 2021] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:35.985060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b261-0b87-459d-aaee-a1aa1b03a684 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:35.996216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b261-0b87-459d-aaee-a1aa1b03a684 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:35.996961 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1093/2220] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:35 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:36.019746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3306cd-d2fb-4105-8b7a-0401de6aeca1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:36.022716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7c3306cd-d2fb-4105-8b7a-0401de6aeca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:36.060784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a57ab-a0e9-414a-8ff4-6dc8de29ddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:36.061555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a57ab-a0e9-414a-8ff4-6dc8de29ddf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:36.061910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a57ab-a0e9-414a-8ff4-6dc8de29ddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:36.062283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a57ab-a0e9-414a-8ff4-6dc8de29ddf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:36.063134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a57ab-a0e9-414a-8ff4-6dc8de29ddf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:36.064884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a57ab-a0e9-414a-8ff4-6dc8de29ddf8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:36.081409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1128/2221] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:35 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:36.082113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a57ab-a0e9-414a-8ff4-6dc8de29ddf8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:36.082760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3306cd-d2fb-4105-8b7a-0401de6aeca1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:36.086602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2bdc0-4ef9-40da-853a-b7bc4b042e87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:36.087401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bdc0-4ef9-40da-853a-b7bc4b042e87 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:36.087687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bdc0-4ef9-40da-853a-b7bc4b042e87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:36.088538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bdc0-4ef9-40da-853a-b7bc4b042e87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:36.093329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a57ab-a0e9-414a-8ff4-6dc8de29ddf8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:36.098939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b5821-00be-4705-b509-10c57c6b986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:36.099821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5821-00be-4705-b509-10c57c6b986f admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:36.100105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5821-00be-4705-b509-10c57c6b986f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:36.100385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b5821-00be-4705-b509-10c57c6b986f admin admin] PATH_INFO: `/v3/projects/c8d36915928d444999cdc421765ba5be/users/2e69debc93124a1f8ccb08b9ce0b10a3/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:36.121709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b5821-00be-4705-b509-10c57c6b986f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d36915928d444999cdc421765ba5be, user_id=2e69debc93124a1f8ccb08b9ce0b10a3, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:36.124400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b5821-00be-4705-b509-10c57c6b986f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:36.151368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2bdc0-4ef9-40da-853a-b7bc4b042e87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:36.152846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2bdc0-4ef9-40da-853a-b7bc4b042e87 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:36.162039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1094/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:36 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:36.228776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1129/2223] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:36 2021] PUT /identity/v3/projects/c8d36915928d444999cdc421765ba5be/users/2e69debc93124a1f8ccb08b9ce0b10a3/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:36.230086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2bdc0-4ef9-40da-853a-b7bc4b042e87 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:36.242937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2bdc0-4ef9-40da-853a-b7bc4b042e87 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:36.299838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cc5c2-ec6a-4981-8d9e-07314f300d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:36.300504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc5c2-ec6a-4981-8d9e-07314f300d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:36.300952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc5c2-ec6a-4981-8d9e-07314f300d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:36.301227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc5c2-ec6a-4981-8d9e-07314f300d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:36.302039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cc5c2-ec6a-4981-8d9e-07314f300d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:36.303659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cc5c2-ec6a-4981-8d9e-07314f300d18 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:36.313478 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1095/2224] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:36 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:36.317739 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b5821-00be-4705-b509-10c57c6b986f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:36.328658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b5821-00be-4705-b509-10c57c6b986f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:36.333516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8114f1-5d28-4a56-95bb-f6ed349785d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:36.336970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8114f1-5d28-4a56-95bb-f6ed349785d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:36.336970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8114f1-5d28-4a56-95bb-f6ed349785d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:36.336970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8114f1-5d28-4a56-95bb-f6ed349785d2 admin admin] PATH_INFO: `/v3/projects/c8d36915928d444999cdc421765ba5be/users/2e69debc93124a1f8ccb08b9ce0b10a3/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:36.336970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8114f1-5d28-4a56-95bb-f6ed349785d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d36915928d444999cdc421765ba5be, user_id=2e69debc93124a1f8ccb08b9ce0b10a3, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:36.340317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8114f1-5d28-4a56-95bb-f6ed349785d2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:36.350933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1130/2225] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:36 2021] PUT /identity/v3/projects/c8d36915928d444999cdc421765ba5be/users/2e69debc93124a1f8ccb08b9ce0b10a3/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:36.369278 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47589-4585-49ec-9a2d-a035de2b0f8e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:36.369278 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47589-4585-49ec-9a2d-a035de2b0f8e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:36.369278 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47589-4585-49ec-9a2d-a035de2b0f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:36.388986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d6c47589-4585-49ec-9a2d-a035de2b0f8e None None] MFA Rules not processed for user `2e69debc93124a1f8ccb08b9ce0b10a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:36.390257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d6c47589-4585-49ec-9a2d-a035de2b0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:36.517033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1096/2226] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:36 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:36.557430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8114f1-5d28-4a56-95bb-f6ed349785d2 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:36.611904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8114f1-5d28-4a56-95bb-f6ed349785d2 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:36.615698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75738f15-619c-4cf6-a744-b1ab5b64923b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:36.616352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738f15-619c-4cf6-a744-b1ab5b64923b service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:36.616608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738f15-619c-4cf6-a744-b1ab5b64923b service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:36.616901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738f15-619c-4cf6-a744-b1ab5b64923b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:36.618789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-75738f15-619c-4cf6-a744-b1ab5b64923b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:36.675667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75738f15-619c-4cf6-a744-b1ab5b64923b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:36.677090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75738f15-619c-4cf6-a744-b1ab5b64923b service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:36.686181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1131/2227] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:36 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:39.949335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47589-4585-49ec-9a2d-a035de2b0f8e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:39.949811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d6c47589-4585-49ec-9a2d-a035de2b0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:40.016163 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47589-4585-49ec-9a2d-a035de2b0f8e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:40.020710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:40.021560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:40.021856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:40.022123 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] PATH_INFO: `/v3/users/67ef27051301416f8654d31205fe78ec` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:40.023330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ef27051301416f8654d31205fe78ec)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:40.025275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:40.227223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ef27051301416f8654d31205fe78ec'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:40.227881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ef27051301416f8654d31205fe78ec'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:40.228482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ef27051301416f8654d31205fe78ec'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:40.310043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ef27051301416f8654d31205fe78ec'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:40.324773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ef27051301416f8654d31205fe78ec'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:40.336900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1097/2228] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:39 2021] DELETE /identity/v3/users/67ef27051301416f8654d31205fe78ec => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:40.342798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f150df-7075-4b0b-a065-99dd44de0849 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:40.343346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f150df-7075-4b0b-a065-99dd44de0849 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:40.343850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f150df-7075-4b0b-a065-99dd44de0849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:40.366230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-45f150df-7075-4b0b-a065-99dd44de0849 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:40.367853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-45f150df-7075-4b0b-a065-99dd44de0849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:40.426175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1132/2229] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:40.436809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:40.438198 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:40.494921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e2995-0317-45f0-aeba-2b9bada3fcd6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:40.499210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:40.499852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:40.500135 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:40.500408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:40.509688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:40.511765 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:40.523709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1098/2230] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:40.725239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f150df-7075-4b0b-a065-99dd44de0849 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:40.726765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-45f150df-7075-4b0b-a065-99dd44de0849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:40.790899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f150df-7075-4b0b-a065-99dd44de0849 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:40.795149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:40.795789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:40.796060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:40.796327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:40.798182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:40.858698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:40.861102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:40.870294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1133/2231] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:40 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:41.013860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:41.015392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:41.029534 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150b498-5d37-4460-9b8e-c09a6b412c59 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:41.035222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:41.037968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:41.038264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:41.038641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] PATH_INFO: `/v3/projects/e371a68de0414ffda6dd74bcbe6b8d09` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:41.040974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e371a68de0414ffda6dd74bcbe6b8d09)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:41.045259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:41.160709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e371a68de0414ffda6dd74bcbe6b8d09', 'request_id': 'req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.229492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e371a68de0414ffda6dd74bcbe6b8d09', 'request_id': 'req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.236099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e371a68de0414ffda6dd74bcbe6b8d09', 'request_id': 'req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.247347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] The token cache is being invalidate because project e371a68de0414ffda6dd74bcbe6b8d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:41.247629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.248264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.249798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1099/2232] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:41 2021] DELETE /identity/v3/projects/e371a68de0414ffda6dd74bcbe6b8d09 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:41.255285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:41.266614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb254-2d70-4e60-a975-3eaa72bdb031 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:41.335172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:41.335172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:41.335172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:41.335172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] PATH_INFO: `/v3/users/8c169c07917a48d393f6017dface546f` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:41.335517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c169c07917a48d393f6017dface546f)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:41.336423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:41.538172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c169c07917a48d393f6017dface546f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.538834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c169c07917a48d393f6017dface546f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.539355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c169c07917a48d393f6017dface546f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.640375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c169c07917a48d393f6017dface546f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.652960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-244af479-1eec-42c4-9347-fe83f416dd0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c169c07917a48d393f6017dface546f'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:41.664949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1134/2233] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:41 2021] DELETE /identity/v3/users/8c169c07917a48d393f6017dface546f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:42.077819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:42.079334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:42.092620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4727fa-3eca-4fa9-a5f2-73b83eb18e43 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:42.149680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:42.150536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.150843 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.151113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] PATH_INFO: `/v3/projects/df8f6a9cc4c6440caa1ebd9bca7a1f24` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.152919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8f6a9cc4c6440caa1ebd9bca7a1f24)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:42.154880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:42.269873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8f6a9cc4c6440caa1ebd9bca7a1f24', 'request_id': 'req-f7d57e81-2f3b-41b6-94a2-e08f333575ca'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:42.331866 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8f6a9cc4c6440caa1ebd9bca7a1f24', 'request_id': 'req-f7d57e81-2f3b-41b6-94a2-e08f333575ca'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:42.337612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8f6a9cc4c6440caa1ebd9bca7a1f24', 'request_id': 'req-f7d57e81-2f3b-41b6-94a2-e08f333575ca'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:42.349616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] The token cache is being invalidate because project df8f6a9cc4c6440caa1ebd9bca7a1f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:42.349899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:42.350537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f7d57e81-2f3b-41b6-94a2-e08f333575ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:42.352103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1100/2234] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:42 2021] DELETE /identity/v3/projects/df8f6a9cc4c6440caa1ebd9bca7a1f24 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:42.358617 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebc48-b369-49e4-bfe9-54cdb2362a90 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.358953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebc48-b369-49e4-bfe9-54cdb2362a90 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.359204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebc48-b369-49e4-bfe9-54cdb2362a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.377948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-74cebc48-b369-49e4-bfe9-54cdb2362a90 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:42.379182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-74cebc48-b369-49e4-bfe9-54cdb2362a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:42.458342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1135/2235] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:42.468760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123a36d-bcb1-4e6f-a800-0c805c555c6a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.469053 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123a36d-bcb1-4e6f-a800-0c805c555c6a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.469320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123a36d-bcb1-4e6f-a800-0c805c555c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.487133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7123a36d-bcb1-4e6f-a800-0c805c555c6a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:42.488309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7123a36d-bcb1-4e6f-a800-0c805c555c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:42.497561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1101/2236] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:42.502081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cebc48-b369-49e4-bfe9-54cdb2362a90 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:42.512324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cebc48-b369-49e4-bfe9-54cdb2362a90 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:42.517034 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:42.517684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.518039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.518320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.519107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:42.519406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:42.520990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:42.532886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1136/2237] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:42.543512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123a36d-bcb1-4e6f-a800-0c805c555c6a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:42.552899 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123a36d-bcb1-4e6f-a800-0c805c555c6a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:42.557649 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669dc84-dc94-40a0-ad51-b2af0379e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:42.558852 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669dc84-dc94-40a0-ad51-b2af0379e115 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.559122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669dc84-dc94-40a0-ad51-b2af0379e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.559386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669dc84-dc94-40a0-ad51-b2af0379e115 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.560080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669dc84-dc94-40a0-ad51-b2af0379e115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:42.561965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669dc84-dc94-40a0-ad51-b2af0379e115 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:42.657258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1102/2238] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:42 2021] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:42.658868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:42.669102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c282750-528f-4ff6-8463-e541ff05639c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:42.725546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceb1fa-7a65-496e-a78c-d5cf9fe736a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:42.726256 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb1fa-7a65-496e-a78c-d5cf9fe736a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.726570 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb1fa-7a65-496e-a78c-d5cf9fe736a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.726841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceb1fa-7a65-496e-a78c-d5cf9fe736a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.727537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceb1fa-7a65-496e-a78c-d5cf9fe736a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:42.729727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceb1fa-7a65-496e-a78c-d5cf9fe736a0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:42.817296 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1137/2239] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:42 2021] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:42.821572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669dc84-dc94-40a0-ad51-b2af0379e115 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:42.833700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669dc84-dc94-40a0-ad51-b2af0379e115 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:42.838530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a6324-8a9d-441c-9eed-df76636a61a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:42.839283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a6324-8a9d-441c-9eed-df76636a61a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.839566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a6324-8a9d-441c-9eed-df76636a61a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.839842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a6324-8a9d-441c-9eed-df76636a61a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.840607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a6324-8a9d-441c-9eed-df76636a61a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:42.842228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a6324-8a9d-441c-9eed-df76636a61a6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:42.852613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1103/2240] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:42.857473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceb1fa-7a65-496e-a78c-d5cf9fe736a0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:42.867835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceb1fa-7a65-496e-a78c-d5cf9fe736a0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:42.873693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7ac2-b2b1-49ca-a351-a016b0299ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:42.876369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7ac2-b2b1-49ca-a351-a016b0299ded admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.876369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7ac2-b2b1-49ca-a351-a016b0299ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.876369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7ac2-b2b1-49ca-a351-a016b0299ded admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.876369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7ac2-b2b1-49ca-a351-a016b0299ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:42.877274 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7ac2-b2b1-49ca-a351-a016b0299ded admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:42.887376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1138/2241] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:42.891617 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a6324-8a9d-441c-9eed-df76636a61a6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:42.901335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a6324-8a9d-441c-9eed-df76636a61a6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:42.905898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fb437-8a05-4ac4-ab82-30f73c1a1518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:42.906811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fb437-8a05-4ac4-ab82-30f73c1a1518 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:42.907086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fb437-8a05-4ac4-ab82-30f73c1a1518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:42.907357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fb437-8a05-4ac4-ab82-30f73c1a1518 admin admin] PATH_INFO: `/v3/projects/102434f074a04b5e91fe0207fa3dd177/users/863c30f13c314dabafab8732a787679d/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:42.921528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fb437-8a05-4ac4-ab82-30f73c1a1518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102434f074a04b5e91fe0207fa3dd177, user_id=863c30f13c314dabafab8732a787679d, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:42.924170 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fb437-8a05-4ac4-ab82-30f73c1a1518 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:43.001294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1104/2242] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:42 2021] PUT /identity/v3/projects/102434f074a04b5e91fe0207fa3dd177/users/863c30f13c314dabafab8732a787679d/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:43.012417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e009d-7b42-48bc-aada-a98511d5acd2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:43.012700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e009d-7b42-48bc-aada-a98511d5acd2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:43.012973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e009d-7b42-48bc-aada-a98511d5acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:43.038667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c12e009d-7b42-48bc-aada-a98511d5acd2 None None] MFA Rules not processed for user `863c30f13c314dabafab8732a787679d`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:43.039907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c12e009d-7b42-48bc-aada-a98511d5acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:43.121796 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1139/2243] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:43 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:43.126454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fb437-8a05-4ac4-ab82-30f73c1a1518 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:43.189850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fb437-8a05-4ac4-ab82-30f73c1a1518 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:43.194597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e283f-d543-43e2-bc4d-5f99f10f13e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:43.195286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e283f-d543-43e2-bc4d-5f99f10f13e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:43.195566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e283f-d543-43e2-bc4d-5f99f10f13e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:43.195840 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e283f-d543-43e2-bc4d-5f99f10f13e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:43.196554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e283f-d543-43e2-bc4d-5f99f10f13e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:43.198457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e283f-d543-43e2-bc4d-5f99f10f13e9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:43.288756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1105/2244] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:43 2021] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:43.293299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e009d-7b42-48bc-aada-a98511d5acd2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:43.304137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e009d-7b42-48bc-aada-a98511d5acd2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:43.362932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ae0fe-b26d-40c9-b314-89c06a0a7384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:43.363602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ae0fe-b26d-40c9-b314-89c06a0a7384 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:43.364379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ae0fe-b26d-40c9-b314-89c06a0a7384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:43.364708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ae0fe-b26d-40c9-b314-89c06a0a7384 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:43.365476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ae0fe-b26d-40c9-b314-89c06a0a7384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:43.367807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ae0fe-b26d-40c9-b314-89c06a0a7384 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:43.480554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1140/2245] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:43 2021] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:43.481715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e283f-d543-43e2-bc4d-5f99f10f13e9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:43.506465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e283f-d543-43e2-bc4d-5f99f10f13e9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:43.506465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784759d4-77b3-4150-b3e5-509892f4638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:43.506465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784759d4-77b3-4150-b3e5-509892f4638f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:43.506465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784759d4-77b3-4150-b3e5-509892f4638f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:43.506836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784759d4-77b3-4150-b3e5-509892f4638f admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:43.506836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784759d4-77b3-4150-b3e5-509892f4638f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:43.508787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784759d4-77b3-4150-b3e5-509892f4638f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:43.531497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1106/2246] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:43 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:43.532716 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ae0fe-b26d-40c9-b314-89c06a0a7384 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:43.544668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ae0fe-b26d-40c9-b314-89c06a0a7384 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:43.551415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a35d4-d47b-4ae0-bf0b-ce9d1538e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:43.552444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a35d4-d47b-4ae0-bf0b-ce9d1538e769 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:43.552810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a35d4-d47b-4ae0-bf0b-ce9d1538e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:43.553164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a35d4-d47b-4ae0-bf0b-ce9d1538e769 admin admin] PATH_INFO: `/v3/projects/be1fbf4df3184f679aa7895402f6d706/users/047c0e7e6a4d4519be29e840d427df7c/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:43.590042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a35d4-d47b-4ae0-bf0b-ce9d1538e769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1fbf4df3184f679aa7895402f6d706, user_id=047c0e7e6a4d4519be29e840d427df7c, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:43.593098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a35d4-d47b-4ae0-bf0b-ce9d1538e769 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:43.697986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1141/2247] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:43 2021] PUT /identity/v3/projects/be1fbf4df3184f679aa7895402f6d706/users/047c0e7e6a4d4519be29e840d427df7c/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:43.702527 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784759d4-77b3-4150-b3e5-509892f4638f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:43.712538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784759d4-77b3-4150-b3e5-509892f4638f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:43.769327 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7b009-248a-46c6-b780-0488c93e8070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:43.769984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7b009-248a-46c6-b780-0488c93e8070 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:43.770262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7b009-248a-46c6-b780-0488c93e8070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:43.770530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7b009-248a-46c6-b780-0488c93e8070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:43.776175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7b009-248a-46c6-b780-0488c93e8070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:43.776175 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7b009-248a-46c6-b780-0488c93e8070 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:43.785616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1107/2248] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:43 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:43.789996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a35d4-d47b-4ae0-bf0b-ce9d1538e769 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:43.800312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a35d4-d47b-4ae0-bf0b-ce9d1538e769 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:43.805004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:43.805873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:43.806167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:43.806461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] PATH_INFO: `/v3/projects/be1fbf4df3184f679aa7895402f6d706/users/047c0e7e6a4d4519be29e840d427df7c/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:43.808469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1fbf4df3184f679aa7895402f6d706, user_id=047c0e7e6a4d4519be29e840d427df7c, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:43.811159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:43.821172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1142/2249] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:43 2021] PUT /identity/v3/projects/be1fbf4df3184f679aa7895402f6d706/users/047c0e7e6a4d4519be29e840d427df7c/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:43.832047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fce6e-527a-41a8-a32f-505bac22b152 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:43.832360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fce6e-527a-41a8-a32f-505bac22b152 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:43.832643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fce6e-527a-41a8-a32f-505bac22b152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:43.859269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6a4fce6e-527a-41a8-a32f-505bac22b152 None None] MFA Rules not processed for user `047c0e7e6a4d4519be29e840d427df7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:43.860487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6a4fce6e-527a-41a8-a32f-505bac22b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:43.926927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1108/2250] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:43 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:44.037964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:44.039751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:44.095378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b9d6-1723-41ca-9f60-c298315e2098 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:44.099077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:44.099798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:44.100053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:44.100320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:44.102127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:44.166189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:44.167699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:44.177024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1143/2251] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:44 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:44.325334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fce6e-527a-41a8-a32f-505bac22b152 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:44.326808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6a4fce6e-527a-41a8-a32f-505bac22b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:44.342828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fce6e-527a-41a8-a32f-505bac22b152 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:44.347028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5508a-2b97-41f8-ba07-e38687b6c137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:44.347831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5508a-2b97-41f8-ba07-e38687b6c137 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:44.348116 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5508a-2b97-41f8-ba07-e38687b6c137 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:44.348394 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5508a-2b97-41f8-ba07-e38687b6c137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:44.412535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5508a-2b97-41f8-ba07-e38687b6c137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:44.413968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5508a-2b97-41f8-ba07-e38687b6c137 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:44.423713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1109/2252] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:44 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:49.418646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:49.429446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c05595-c8a2-4610-8e59-e26cafede99c service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:49.433628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e98e96-4e45-4162-a41a-c90897fad658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:49.435106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98e96-4e45-4162-a41a-c90897fad658 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:49.435786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98e96-4e45-4162-a41a-c90897fad658 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:49.436224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98e96-4e45-4162-a41a-c90897fad658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:49.438841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-83e98e96-4e45-4162-a41a-c90897fad658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:49.502226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e98e96-4e45-4162-a41a-c90897fad658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:49.503781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e98e96-4e45-4162-a41a-c90897fad658 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:49.519753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1144/2253] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:49 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:50.000797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5508a-2b97-41f8-ba07-e38687b6c137 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:50.063289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5508a-2b97-41f8-ba07-e38687b6c137 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:50.068484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:50.069355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:50.069637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:50.069910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] PATH_INFO: `/v3/users/863c30f13c314dabafab8732a787679d` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:50.071138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=863c30f13c314dabafab8732a787679d)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:50.073034 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:50.290907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863c30f13c314dabafab8732a787679d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:50.291554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863c30f13c314dabafab8732a787679d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:50.292217 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863c30f13c314dabafab8732a787679d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:50.435236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863c30f13c314dabafab8732a787679d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:50.451289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863c30f13c314dabafab8732a787679d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:50.466057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1110/2254] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:49 2021] DELETE /identity/v3/users/863c30f13c314dabafab8732a787679d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:50.470768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de84456-7457-48c0-835b-03ec36f84c81 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:50.471251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de84456-7457-48c0-835b-03ec36f84c81 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:50.471356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de84456-7457-48c0-835b-03ec36f84c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:50.490981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3de84456-7457-48c0-835b-03ec36f84c81 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:50.492210 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3de84456-7457-48c0-835b-03ec36f84c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:50.575754 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1145/2255] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:50.591643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:50.593274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:50.659977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b4f46-47d4-4421-bcb6-9a246ce942f2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:50.663853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665d409-8e67-4cb4-915d-d4f4660cce83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:50.664497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d409-8e67-4cb4-915d-d4f4660cce83 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:50.664775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d409-8e67-4cb4-915d-d4f4660cce83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:50.665045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665d409-8e67-4cb4-915d-d4f4660cce83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:50.674570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665d409-8e67-4cb4-915d-d4f4660cce83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:50.678286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665d409-8e67-4cb4-915d-d4f4660cce83 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:50.686655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1111/2256] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:50.723037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de84456-7457-48c0-835b-03ec36f84c81 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:50.724828 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3de84456-7457-48c0-835b-03ec36f84c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:50.740757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de84456-7457-48c0-835b-03ec36f84c81 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:50.747611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:50.749480 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:50.750053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:50.750053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] PATH_INFO: `/v3/users/1863c113c5dc4b40bf26177a07aaee6e` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:50.751411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1863c113c5dc4b40bf26177a07aaee6e)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:50.754071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:51.079971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1863c113c5dc4b40bf26177a07aaee6e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.080737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1863c113c5dc4b40bf26177a07aaee6e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.081442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1863c113c5dc4b40bf26177a07aaee6e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.177676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1863c113c5dc4b40bf26177a07aaee6e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.194181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1863c113c5dc4b40bf26177a07aaee6e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.205891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1146/2257] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:50 2021] DELETE /identity/v3/users/1863c113c5dc4b40bf26177a07aaee6e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:51.210400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4914ae-bfbc-4aa0-b683-8d01944392b9 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:51.211277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4914ae-bfbc-4aa0-b683-8d01944392b9 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:51.211558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4914ae-bfbc-4aa0-b683-8d01944392b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:51.231639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ac4914ae-bfbc-4aa0-b683-8d01944392b9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:51.233010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ac4914ae-bfbc-4aa0-b683-8d01944392b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:51.291092 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1112/2258] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:51.300499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:51.302469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:51.311063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4914ae-bfbc-4aa0-b683-8d01944392b9 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:51.313519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ac4914ae-bfbc-4aa0-b683-8d01944392b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:51.324784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64d621-e46b-4cf8-ab1d-54c91b33d631 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:51.339938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:51.341380 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:51.341718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:51.342050 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] PATH_INFO: `/v3/projects/102434f074a04b5e91fe0207fa3dd177` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:51.343659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102434f074a04b5e91fe0207fa3dd177)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:51.345908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:51.382520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4914ae-bfbc-4aa0-b683-8d01944392b9 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:51.388942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:51.389661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:51.389994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:51.390221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:51.406723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:51.406723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:51.413770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1113/2259] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:51.414693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:51.416041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:51.429637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898234a2-90f9-4e25-a0eb-f9ad2dabff0f service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:51.434650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:51.435522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:51.435757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:51.436035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] PATH_INFO: `/v3/users/f3f669a191d5407db24f3f5ff6322fcc` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:51.437271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f669a191d5407db24f3f5ff6322fcc)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:51.439294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:51.566907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102434f074a04b5e91fe0207fa3dd177', 'request_id': 'req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.675084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102434f074a04b5e91fe0207fa3dd177', 'request_id': 'req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.683109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102434f074a04b5e91fe0207fa3dd177', 'request_id': 'req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.693359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] The token cache is being invalidate because project 102434f074a04b5e91fe0207fa3dd177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:51.693580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.693748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f669a191d5407db24f3f5ff6322fcc'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.694231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.694570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f669a191d5407db24f3f5ff6322fcc'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.695809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f669a191d5407db24f3f5ff6322fcc'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.696536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1147/2260] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:51 2021] DELETE /identity/v3/projects/102434f074a04b5e91fe0207fa3dd177 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:51.701896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:51.703300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:51.799244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c21b9-3cad-4a41-adbf-a9abda77d3c1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:51.804737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:51.805710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:51.805926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:51.806201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] PATH_INFO: `/v3/users/047c0e7e6a4d4519be29e840d427df7c` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:51.808609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=047c0e7e6a4d4519be29e840d427df7c)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:51.810747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:51.823724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f669a191d5407db24f3f5ff6322fcc'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.839623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c691e8e8-db92-4185-a3ce-041d83e17b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f669a191d5407db24f3f5ff6322fcc'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:51.856722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1114/2261] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:51 2021] DELETE /identity/v3/users/f3f669a191d5407db24f3f5ff6322fcc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:51.860938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701577d8-5b61-4647-b450-d8ce821d68c7 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:51.861226 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701577d8-5b61-4647-b450-d8ce821d68c7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:51.861504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701577d8-5b61-4647-b450-d8ce821d68c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:51.879805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-701577d8-5b61-4647-b450-d8ce821d68c7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:51.890005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-701577d8-5b61-4647-b450-d8ce821d68c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:51.941583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1115/2262] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:51.953916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701577d8-5b61-4647-b450-d8ce821d68c7 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:51.955413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-701577d8-5b61-4647-b450-d8ce821d68c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:52.016287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701577d8-5b61-4647-b450-d8ce821d68c7 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:52.020370 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:52.021053 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:52.021338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:52.021616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:52.032693 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:52.034447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:52.045446 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1116/2263] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:52.048136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:52.048136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:52.060977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acbd79-9aa4-4a8d-92c9-57ef88b116e1 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:52.066349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:52.067379 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:52.067668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:52.067944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] PATH_INFO: `/v3/projects/72534932c4f54edda4799fb2bfd2fe7b` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:52.069231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72534932c4f54edda4799fb2bfd2fe7b)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:52.071201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:52.089375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047c0e7e6a4d4519be29e840d427df7c'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.090207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047c0e7e6a4d4519be29e840d427df7c'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.091639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047c0e7e6a4d4519be29e840d427df7c'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.177836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047c0e7e6a4d4519be29e840d427df7c'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.195099 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047c0e7e6a4d4519be29e840d427df7c'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.227586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72534932c4f54edda4799fb2bfd2fe7b', 'request_id': 'req-ac526e30-1930-46ec-941d-0f48bb30e46f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.232582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1148/2264] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:51 2021] DELETE /identity/v3/users/047c0e7e6a4d4519be29e840d427df7c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:52.292278 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72534932c4f54edda4799fb2bfd2fe7b', 'request_id': 'req-ac526e30-1930-46ec-941d-0f48bb30e46f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.302836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72534932c4f54edda4799fb2bfd2fe7b', 'request_id': 'req-ac526e30-1930-46ec-941d-0f48bb30e46f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.321050 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] The token cache is being invalidate because project 72534932c4f54edda4799fb2bfd2fe7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:52.321425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.323143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.326253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1117/2265] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:52 2021] DELETE /identity/v3/projects/72534932c4f54edda4799fb2bfd2fe7b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:52.330472 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:52.332015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:52.449588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd26d6-f282-4bfd-adb2-15ca60b3d99f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:52.458213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:52.459155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:52.459937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:52.460052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] PATH_INFO: `/v3/users/1900b323f8ca43b89389efdff8f781a9` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:52.463003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1900b323f8ca43b89389efdff8f781a9)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:52.463897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:52.598875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:52.601026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:52.686704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1900b323f8ca43b89389efdff8f781a9'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.689215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1900b323f8ca43b89389efdff8f781a9'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.690027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1900b323f8ca43b89389efdff8f781a9'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.736432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac526e30-1930-46ec-941d-0f48bb30e46f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:52.744165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:52.745289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:52.745388 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:52.745653 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] PATH_INFO: `/v3/projects/aa634cc6477c4e9487991d2dd18155aa` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:52.747658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa634cc6477c4e9487991d2dd18155aa)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:52.749820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:52.759910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1900b323f8ca43b89389efdff8f781a9'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.781095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1900b323f8ca43b89389efdff8f781a9'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.795689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1149/2266] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:52 2021] DELETE /identity/v3/users/1900b323f8ca43b89389efdff8f781a9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:52.841587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa634cc6477c4e9487991d2dd18155aa', 'request_id': 'req-5f2014cb-3658-4da8-a34f-8f426e0a3690'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.851362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:52.852992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:52.920082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa634cc6477c4e9487991d2dd18155aa', 'request_id': 'req-5f2014cb-3658-4da8-a34f-8f426e0a3690'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.926436 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa634cc6477c4e9487991d2dd18155aa', 'request_id': 'req-5f2014cb-3658-4da8-a34f-8f426e0a3690'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.927383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f031-ee0e-4cc6-9473-f9eff4fe8596 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:52.940485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] The token cache is being invalidate because project aa634cc6477c4e9487991d2dd18155aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:52.940829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.941714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f2014cb-3658-4da8-a34f-8f426e0a3690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:52.944149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1118/2267] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:52 2021] DELETE /identity/v3/projects/aa634cc6477c4e9487991d2dd18155aa => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:52.951067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faedb4a-53ab-432c-9679-9c1e6cd28021 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:52.951397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faedb4a-53ab-432c-9679-9c1e6cd28021 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:52.951814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faedb4a-53ab-432c-9679-9c1e6cd28021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:52.972622 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1faedb4a-53ab-432c-9679-9c1e6cd28021 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:52.974038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1faedb4a-53ab-432c-9679-9c1e6cd28021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:52.992891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:52.993927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:52.994205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:52.994476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] PATH_INFO: `/v3/projects/be1fbf4df3184f679aa7895402f6d706` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:52.995703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1fbf4df3184f679aa7895402f6d706)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:52.998300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.044420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1119/2268] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:53.052881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533032f1-f18c-4bfd-b93d-c0b071cc9b06 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.053236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533032f1-f18c-4bfd-b93d-c0b071cc9b06 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.054531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533032f1-f18c-4bfd-b93d-c0b071cc9b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.075778 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-533032f1-f18c-4bfd-b93d-c0b071cc9b06 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:53.076960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-533032f1-f18c-4bfd-b93d-c0b071cc9b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:53.085423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1120/2269] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:53.089560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533032f1-f18c-4bfd-b93d-c0b071cc9b06 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.098620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533032f1-f18c-4bfd-b93d-c0b071cc9b06 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.103210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.104105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.104376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.104641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.105369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:53.105712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.107393 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.119569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1121/2270] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:15:53.124592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.133945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef6078-48c0-4d41-946a-dad1ad741864 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.139799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.140482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.140764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.141033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.141812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.147205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.162904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1fbf4df3184f679aa7895402f6d706', 'request_id': 'req-92006e1b-5b0e-484a-be8a-7435445a6c86'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.252120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1fbf4df3184f679aa7895402f6d706', 'request_id': 'req-92006e1b-5b0e-484a-be8a-7435445a6c86'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.258099 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1fbf4df3184f679aa7895402f6d706', 'request_id': 'req-92006e1b-5b0e-484a-be8a-7435445a6c86'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.269198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] The token cache is being invalidate because project be1fbf4df3184f679aa7895402f6d706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:53.269478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.270119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-92006e1b-5b0e-484a-be8a-7435445a6c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.271686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1150/2271] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:52 2021] DELETE /identity/v3/projects/be1fbf4df3184f679aa7895402f6d706 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:53.277446 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b4b2-a15f-40bd-9865-a36a960de0d9 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.277734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b4b2-a15f-40bd-9865-a36a960de0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.278008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b4b2-a15f-40bd-9865-a36a960de0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.296789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1122/2272] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:53 2021] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:53.301893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.303285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-f6c2b4b2-a15f-40bd-9865-a36a960de0d9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:53.303627 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:53.307850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f6c2b4b2-a15f-40bd-9865-a36a960de0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:53.372600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1151/2273] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:53.373827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2b4b2-a15f-40bd-9865-a36a960de0d9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.375313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f6c2b4b2-a15f-40bd-9865-a36a960de0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:53.381438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b78d3-bfe5-4305-968d-f016511463de admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.387936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2b4b2-a15f-40bd-9865-a36a960de0d9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.389540 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.391452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.391838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.392861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] PATH_INFO: `/v3/projects/7d72f956ace74ab6b468d43af934ca87` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.393534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c1020-9f8e-4c18-a3cb-2268df4c99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.394170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1020-9f8e-4c18-a3cb-2268df4c99c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.394450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1020-9f8e-4c18-a3cb-2268df4c99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.394688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d72f956ace74ab6b468d43af934ca87)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.394905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1020-9f8e-4c18-a3cb-2268df4c99c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.395630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1020-9f8e-4c18-a3cb-2268df4c99c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.396930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.397585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1020-9f8e-4c18-a3cb-2268df4c99c4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.504710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1152/2274] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:53 2021] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:53.505977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d995f34-17c0-4f2b-8b3f-021ac6d4a28f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.506259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d995f34-17c0-4f2b-8b3f-021ac6d4a28f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.506527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d995f34-17c0-4f2b-8b3f-021ac6d4a28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.525393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-1d995f34-17c0-4f2b-8b3f-021ac6d4a28f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:53.528320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1d995f34-17c0-4f2b-8b3f-021ac6d4a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:53.538326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1153/2275] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:53.539235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d995f34-17c0-4f2b-8b3f-021ac6d4a28f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.549316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d995f34-17c0-4f2b-8b3f-021ac6d4a28f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.555612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd721ff-0ad0-4078-a382-eebe8e9ef0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.555612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd721ff-0ad0-4078-a382-eebe8e9ef0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.555612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd721ff-0ad0-4078-a382-eebe8e9ef0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.555612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd721ff-0ad0-4078-a382-eebe8e9ef0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.556145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd721ff-0ad0-4078-a382-eebe8e9ef0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.558765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd721ff-0ad0-4078-a382-eebe8e9ef0c0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.572452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1154/2276] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:53.572452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd721ff-0ad0-4078-a382-eebe8e9ef0c0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.576411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d72f956ace74ab6b468d43af934ca87', 'request_id': 'req-5f0e33f7-2cb6-43db-b1d0-2ef951751328'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.581672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd721ff-0ad0-4078-a382-eebe8e9ef0c0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.641267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.642198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.642484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.642802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.643555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:53.643833 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.645472 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.657697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1155/2277] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:53.658972 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.669269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40e8f7-3fb3-4950-aa15-6bbb7d4b3d97 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.669588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d72f956ace74ab6b468d43af934ca87', 'request_id': 'req-5f0e33f7-2cb6-43db-b1d0-2ef951751328'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.676760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d72f956ace74ab6b468d43af934ca87', 'request_id': 'req-5f0e33f7-2cb6-43db-b1d0-2ef951751328'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.677805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa590ac-435a-438b-8558-20fc56c14756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.678466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa590ac-435a-438b-8558-20fc56c14756 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.678767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa590ac-435a-438b-8558-20fc56c14756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.679038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa590ac-435a-438b-8558-20fc56c14756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.679771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa590ac-435a-438b-8558-20fc56c14756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.681362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa590ac-435a-438b-8558-20fc56c14756 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.691826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] The token cache is being invalidate because project 7d72f956ace74ab6b468d43af934ca87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:53.692139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1156/2278] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:53 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:53.692701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa590ac-435a-438b-8558-20fc56c14756 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.693261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.694295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:53.709132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1123/2279] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:53 2021] DELETE /identity/v3/projects/7d72f956ace74ab6b468d43af934ca87 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:53.709132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.709132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:53.709402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa590ac-435a-438b-8558-20fc56c14756 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.714113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459287c3-53eb-40f7-99e9-50eb6fff75a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.715135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459287c3-53eb-40f7-99e9-50eb6fff75a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.716028 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459287c3-53eb-40f7-99e9-50eb6fff75a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.716193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459287c3-53eb-40f7-99e9-50eb6fff75a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.716962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459287c3-53eb-40f7-99e9-50eb6fff75a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.717757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e33f7-2cb6-43db-b1d0-2ef951751328 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.720572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459287c3-53eb-40f7-99e9-50eb6fff75a1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.734315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:53.735715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.738818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.738818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] PATH_INFO: `/v3/projects/7c547cfc08f04fe3a7bbd5fe890899df/users/68268c0fd6bb4840b838a1790a77a46d/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.755781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c547cfc08f04fe3a7bbd5fe890899df, user_id=68268c0fd6bb4840b838a1790a77a46d, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:53.758385 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:53.858042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1157/2280] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:53 2021] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:53.858042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76b75-51be-4f50-b627-63a50c76bd58 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:53.858042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76b75-51be-4f50-b627-63a50c76bd58 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:53.858042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76b75-51be-4f50-b627-63a50c76bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:53.858509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1124/2281] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:53 2021] PUT /identity/v3/projects/7c547cfc08f04fe3a7bbd5fe890899df/users/68268c0fd6bb4840b838a1790a77a46d/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:53.859699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.861845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:53.883878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9dd76b75-51be-4f50-b627-63a50c76bd58 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:53.885118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9dd76b75-51be-4f50-b627-63a50c76bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:53.950439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670740-738e-4dbb-95cd-e3be22044411 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:53.974063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1158/2282] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:53.982810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd76b75-51be-4f50-b627-63a50c76bd58 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:53.988255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9dd76b75-51be-4f50-b627-63a50c76bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.004429 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd76b75-51be-4f50-b627-63a50c76bd58 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.007872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77d289-7522-4194-80a5-04d043e1be6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.008741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77d289-7522-4194-80a5-04d043e1be6d admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.009031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77d289-7522-4194-80a5-04d043e1be6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.009397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77d289-7522-4194-80a5-04d043e1be6d admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.010213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77d289-7522-4194-80a5-04d043e1be6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.012835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77d289-7522-4194-80a5-04d043e1be6d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.024775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.025679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.025958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.026228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] PATH_INFO: `/v3/users/055ab73a1642467c96847e99ed9f7487` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.027823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] RBAC: Authorizing `identity:delete_user(user_id=055ab73a1642467c96847e99ed9f7487)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.030245 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.098674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1159/2283] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:53 2021] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:54.100285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e5311-7780-4f78-9448-55eb8f1866fc None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.100600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e5311-7780-4f78-9448-55eb8f1866fc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.100875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e5311-7780-4f78-9448-55eb8f1866fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.128702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-902e5311-7780-4f78-9448-55eb8f1866fc None None] MFA Rules not processed for user `68268c0fd6bb4840b838a1790a77a46d`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:54.129924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-902e5311-7780-4f78-9448-55eb8f1866fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.203787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1160/2284] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:54 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:54.205226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273a7d-6d2b-4245-8b52-03767e1d1c47 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.205525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273a7d-6d2b-4245-8b52-03767e1d1c47 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.205802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273a7d-6d2b-4245-8b52-03767e1d1c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.220305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055ab73a1642467c96847e99ed9f7487'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:54.220989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055ab73a1642467c96847e99ed9f7487'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:54.221599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055ab73a1642467c96847e99ed9f7487'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:54.225511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-bd273a7d-6d2b-4245-8b52-03767e1d1c47 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:54.226735 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bd273a7d-6d2b-4245-8b52-03767e1d1c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.240749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1161/2285] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:54.241599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd273a7d-6d2b-4245-8b52-03767e1d1c47 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.242921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bd273a7d-6d2b-4245-8b52-03767e1d1c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.254825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd273a7d-6d2b-4245-8b52-03767e1d1c47 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.266121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.266121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.266121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.266121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.266534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.266534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.273787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1162/2286] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:54.274608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.276249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.331131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89bed7-2c38-4755-a5e5-772db8be08a5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.334897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a061423c1f646b8892d646979f84f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.335534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.335819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.336082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.337865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.349466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.350959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.360389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1163/2287] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:54 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:54.361167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.371209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6782dc-99a5-493f-b9c2-b8c143e3ad30 service glance] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.376634 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.377286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.377646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.377995 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.378581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055ab73a1642467c96847e99ed9f7487'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:54.379358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:54.379358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.380484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.393809 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1164/2288] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:54.394703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.399570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055ab73a1642467c96847e99ed9f7487'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:54.407354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e06c8-0a8c-4ee1-8542-a7174a377411 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.413140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559d325-d856-4958-8760-9effee1f4590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.413684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d325-d856-4958-8760-9effee1f4590 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.413973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d325-d856-4958-8760-9effee1f4590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.414249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d325-d856-4958-8760-9effee1f4590 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.414925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1125/2289] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:53 2021] DELETE /identity/v3/users/055ab73a1642467c96847e99ed9f7487 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:54.415368 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559d325-d856-4958-8760-9effee1f4590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.417100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559d325-d856-4958-8760-9effee1f4590 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.419185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.428949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1165/2290] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:54.430264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8281-c423-451c-a00e-e02fce89a3e2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.430766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8281-c423-451c-a00e-e02fce89a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.431053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a8281-c423-451c-a00e-e02fce89a3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.459214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4a3a8281-c423-451c-a00e-e02fce89a3e2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:54.460464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4a3a8281-c423-451c-a00e-e02fce89a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.495740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404010-504b-47b0-9554-90afdf67738d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.507148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.508030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.508374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.508650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.509573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.514855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.527945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1166/2291] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:54.528854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a8281-c423-451c-a00e-e02fce89a3e2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.540734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a8281-c423-451c-a00e-e02fce89a3e2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.545738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f68b13-bcdf-4271-9c17-33385fdcf5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.546698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f68b13-bcdf-4271-9c17-33385fdcf5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.546987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f68b13-bcdf-4271-9c17-33385fdcf5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.547295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f68b13-bcdf-4271-9c17-33385fdcf5a4 admin admin] PATH_INFO: `/v3/projects/b608061172d640d5ac7b5df94eb98243/users/b3e095b10247471bb2521bb73b700205/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.571807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f68b13-bcdf-4271-9c17-33385fdcf5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b608061172d640d5ac7b5df94eb98243, user_id=b3e095b10247471bb2521bb73b700205, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.580158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f68b13-bcdf-4271-9c17-33385fdcf5a4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.660407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1126/2292] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:54 2021] POST /identity/v3/projects => generated 363 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:54.661281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.662873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.718879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b9765-18da-4c38-b33a-837aa36c1e92 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.722496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3447b-0d64-4f49-93ba-f6c79ea51881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.723168 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3447b-0d64-4f49-93ba-f6c79ea51881 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.723470 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3447b-0d64-4f49-93ba-f6c79ea51881 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.723770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3447b-0d64-4f49-93ba-f6c79ea51881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.731971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1167/2293] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:54 2021] PUT /identity/v3/projects/b608061172d640d5ac7b5df94eb98243/users/b3e095b10247471bb2521bb73b700205/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:54.734813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f68b13-bcdf-4271-9c17-33385fdcf5a4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.790718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3447b-0d64-4f49-93ba-f6c79ea51881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.792619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3447b-0d64-4f49-93ba-f6c79ea51881 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.804529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f68b13-bcdf-4271-9c17-33385fdcf5a4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.805388 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1127/2294] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:54.806959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89ffce-9329-4ee0-a99f-26a4eff499f2 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.807235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89ffce-9329-4ee0-a99f-26a4eff499f2 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.807512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89ffce-9329-4ee0-a99f-26a4eff499f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.811653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190a420-68a7-44af-82d0-30f39f5b38a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.812324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190a420-68a7-44af-82d0-30f39f5b38a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.813248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190a420-68a7-44af-82d0-30f39f5b38a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.813576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190a420-68a7-44af-82d0-30f39f5b38a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.814242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190a420-68a7-44af-82d0-30f39f5b38a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.816486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190a420-68a7-44af-82d0-30f39f5b38a3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.835023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-da89ffce-9329-4ee0-a99f-26a4eff499f2 None None] MFA Rules not processed for user `b3e095b10247471bb2521bb73b700205`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:54.836233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-da89ffce-9329-4ee0-a99f-26a4eff499f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.909968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1168/2295] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:54 2021] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:54.911740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190a420-68a7-44af-82d0-30f39f5b38a3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.922426 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190a420-68a7-44af-82d0-30f39f5b38a3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.925220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1128/2296] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:54.927495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66610b-1172-415e-89fc-3b3c8fa82113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.928164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66610b-1172-415e-89fc-3b3c8fa82113 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.928986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66610b-1172-415e-89fc-3b3c8fa82113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.928986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66610b-1172-415e-89fc-3b3c8fa82113 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.929778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66610b-1172-415e-89fc-3b3c8fa82113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.931418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66610b-1172-415e-89fc-3b3c8fa82113 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.943718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1169/2297] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:54.943935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89ffce-9329-4ee0-a99f-26a4eff499f2 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.947753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-da89ffce-9329-4ee0-a99f-26a4eff499f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:54.951987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66610b-1172-415e-89fc-3b3c8fa82113 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:54.967475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66610b-1172-415e-89fc-3b3c8fa82113 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:54.977206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d1871-88f1-4c23-b398-d64d60040c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:54.977691 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1871-88f1-4c23-b398-d64d60040c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:54.977982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1871-88f1-4c23-b398-d64d60040c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:54.979153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1871-88f1-4c23-b398-d64d60040c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:54.980243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d1871-88f1-4c23-b398-d64d60040c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:54.982308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d1871-88f1-4c23-b398-d64d60040c24 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:54.994266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1170/2298] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:54.998923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d1871-88f1-4c23-b398-d64d60040c24 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:55.009263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d1871-88f1-4c23-b398-d64d60040c24 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:55.013629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89ffce-9329-4ee0-a99f-26a4eff499f2 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:55.014480 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137637e-a466-4345-99ec-25b5ddf3a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:55.015377 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137637e-a466-4345-99ec-25b5ddf3a715 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.015657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137637e-a466-4345-99ec-25b5ddf3a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.015980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137637e-a466-4345-99ec-25b5ddf3a715 admin admin] PATH_INFO: `/v3/projects/160f3377b4d74251a6bc4363faca7e89/users/2636892525874d15bf28bf913d147ecd/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.017810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dccfb7-153d-4281-b352-ea71f418eda6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:55.018525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dccfb7-153d-4281-b352-ea71f418eda6 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.018930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dccfb7-153d-4281-b352-ea71f418eda6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.019272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dccfb7-153d-4281-b352-ea71f418eda6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.028857 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dccfb7-153d-4281-b352-ea71f418eda6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:55.030291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dccfb7-153d-4281-b352-ea71f418eda6 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:55.032157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137637e-a466-4345-99ec-25b5ddf3a715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160f3377b4d74251a6bc4363faca7e89, user_id=2636892525874d15bf28bf913d147ecd, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:55.034942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137637e-a466-4345-99ec-25b5ddf3a715 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:55.039430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1129/2299] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:54 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:55.172664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1171/2300] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:54 2021] PUT /identity/v3/projects/160f3377b4d74251a6bc4363faca7e89/users/2636892525874d15bf28bf913d147ecd/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:55.175073 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8931c26-a3e6-49ea-9757-c2f976c4775c None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.175230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8931c26-a3e6-49ea-9757-c2f976c4775c None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.175476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8931c26-a3e6-49ea-9757-c2f976c4775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.219027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-f8931c26-a3e6-49ea-9757-c2f976c4775c None None] MFA Rules not processed for user `2636892525874d15bf28bf913d147ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:55.220304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f8931c26-a3e6-49ea-9757-c2f976c4775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:55.297287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1130/2301] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:55 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:55.298203 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137637e-a466-4345-99ec-25b5ddf3a715 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:55.364049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8931c26-a3e6-49ea-9757-c2f976c4775c None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:55.365465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f8931c26-a3e6-49ea-9757-c2f976c4775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:55.376054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137637e-a466-4345-99ec-25b5ddf3a715 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:55.382393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108961c6-6616-4a20-8f05-10e93dc0915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:55.382846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8931c26-a3e6-49ea-9757-c2f976c4775c None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:55.383289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108961c6-6616-4a20-8f05-10e93dc0915f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.383547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108961c6-6616-4a20-8f05-10e93dc0915f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.383790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108961c6-6616-4a20-8f05-10e93dc0915f admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.384567 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108961c6-6616-4a20-8f05-10e93dc0915f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:55.386526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108961c6-6616-4a20-8f05-10e93dc0915f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:55.397749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:55.398840 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.399122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.400057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] PATH_INFO: `/v3/projects/3bff428ab3b4496183f70fe549dc36f3` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.401460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bff428ab3b4496183f70fe549dc36f3)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:55.403625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:55.551749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1172/2302] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:55 2021] POST /identity/v3/projects => generated 363 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:55.556342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108961c6-6616-4a20-8f05-10e93dc0915f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:55.564034 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bff428ab3b4496183f70fe549dc36f3', 'request_id': 'req-7b0e6045-87f7-4720-8a00-52c661743367'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:55.623129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108961c6-6616-4a20-8f05-10e93dc0915f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:55.627892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:55.628546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.628826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.629102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.629800 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:55.631746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:55.669394 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bff428ab3b4496183f70fe549dc36f3', 'request_id': 'req-7b0e6045-87f7-4720-8a00-52c661743367'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:55.675684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bff428ab3b4496183f70fe549dc36f3', 'request_id': 'req-7b0e6045-87f7-4720-8a00-52c661743367'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:55.687331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] The token cache is being invalidate because project 3bff428ab3b4496183f70fe549dc36f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:55.687615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:55.688267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:55.689805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1131/2303] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:55 2021] DELETE /identity/v3/projects/3bff428ab3b4496183f70fe549dc36f3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:55.693598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:55.695005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:55.758092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1173/2304] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:55 2021] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:15:55.758683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6045-87f7-4720-8a00-52c661743367 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:55.759261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:55.761283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:55.762209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:55.763107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.763387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.763658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] PATH_INFO: `/v3/users/db4ae46e3e3f463e8957ba6f1d03be67` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.765046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4ae46e3e3f463e8957ba6f1d03be67)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:55.767004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:55.774961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1660-5fb8-4193-8452-6a5ce91a009b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:55.781881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a74a9-6300-465e-940b-0f93d0339e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:55.782678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74a9-6300-465e-940b-0f93d0339e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.782971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74a9-6300-465e-940b-0f93d0339e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.783244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74a9-6300-465e-940b-0f93d0339e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.784025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a74a9-6300-465e-940b-0f93d0339e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:55.785674 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a74a9-6300-465e-940b-0f93d0339e3a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:55.797275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1174/2305] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:55 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:55.803371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a74a9-6300-465e-940b-0f93d0339e3a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:55.813741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a74a9-6300-465e-940b-0f93d0339e3a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:55.818346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb151f94-d479-4cd4-af33-050a66e8c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:55.819257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151f94-d479-4cd4-af33-050a66e8c79b admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:55.819533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151f94-d479-4cd4-af33-050a66e8c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:55.819803 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb151f94-d479-4cd4-af33-050a66e8c79b admin admin] PATH_INFO: `/v3/projects/3872320b9aff4e35b14f27d0011d11ef/users/da7841ddd625483888d8741c5f0461b7/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:55.835436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151f94-d479-4cd4-af33-050a66e8c79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3872320b9aff4e35b14f27d0011d11ef, user_id=da7841ddd625483888d8741c5f0461b7, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:55.838326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb151f94-d479-4cd4-af33-050a66e8c79b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:55.932227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1175/2306] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:55 2021] PUT /identity/v3/projects/3872320b9aff4e35b14f27d0011d11ef/users/da7841ddd625483888d8741c5f0461b7/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:55.936283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb151f94-d479-4cd4-af33-050a66e8c79b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:55.952829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4ae46e3e3f463e8957ba6f1d03be67'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:55.953604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4ae46e3e3f463e8957ba6f1d03be67'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:55.954433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4ae46e3e3f463e8957ba6f1d03be67'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:56.020037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb151f94-d479-4cd4-af33-050a66e8c79b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:56.025107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:56.025788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:56.026065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:56.026338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:56.027122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:56.029402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:56.040137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1176/2307] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:55 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:15:56.045278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:56.046372 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4ae46e3e3f463e8957ba6f1d03be67'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:56.047362 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:56.061065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3763a9-89f8-4fc6-ae1e-bd802ab83dce admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:56.061692 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6a8fd9f6-cfa9-4702-9eeb-8713e0843b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4ae46e3e3f463e8957ba6f1d03be67'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:56.066817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:56.067862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:56.068235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:56.068580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] PATH_INFO: `/v3/projects/3872320b9aff4e35b14f27d0011d11ef/users/da7841ddd625483888d8741c5f0461b7/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:56.070835 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3872320b9aff4e35b14f27d0011d11ef, user_id=da7841ddd625483888d8741c5f0461b7, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:56.073784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:56.082120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1132/2308] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:55 2021] DELETE /identity/v3/users/db4ae46e3e3f463e8957ba6f1d03be67 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:56.092308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1177/2309] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:56 2021] PUT /identity/v3/projects/3872320b9aff4e35b14f27d0011d11ef/users/da7841ddd625483888d8741c5f0461b7/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:56.109440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab8ef-d2c3-45e3-9a0b-818db1c1d54e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:56.109734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab8ef-d2c3-45e3-9a0b-818db1c1d54e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:56.110011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab8ef-d2c3-45e3-9a0b-818db1c1d54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:56.141958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-727ab8ef-d2c3-45e3-9a0b-818db1c1d54e None None] MFA Rules not processed for user `da7841ddd625483888d8741c5f0461b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:56.144712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-727ab8ef-d2c3-45e3-9a0b-818db1c1d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:56.230213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1133/2310] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:56 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:56.241755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:56.243518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:56.302483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862693c3-dc2e-48ae-a1e7-355cc219f5d1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:56.371363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:56.371363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:56.371363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:56.371363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:56.379171 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:56.380973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:56.391774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1178/2311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:56 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:15:56.735489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ab8ef-d2c3-45e3-9a0b-818db1c1d54e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:56.737066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-727ab8ef-d2c3-45e3-9a0b-818db1c1d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:56.807227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ab8ef-d2c3-45e3-9a0b-818db1c1d54e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:56.812538 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:56.813410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:56.813690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:56.813968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] PATH_INFO: `/v3/projects/9fdbd111608f404eba427ac74dff84d4` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:56.815202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdbd111608f404eba427ac74dff84d4)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:56.817172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:56.854402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:56.856019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:56.868307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a3d49-1cb9-4626-ad4d-02c715f2d495 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:56.872773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:56.875780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:56.875780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:56.875780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:56.877290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:56.946526 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:56.948400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:56.951905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdbd111608f404eba427ac74dff84d4', 'request_id': 'req-3fae72b9-78ec-49c7-a133-10829be6b2c7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:56.958966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1179/2312] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:56 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:57.057613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdbd111608f404eba427ac74dff84d4', 'request_id': 'req-3fae72b9-78ec-49c7-a133-10829be6b2c7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.064117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdbd111608f404eba427ac74dff84d4', 'request_id': 'req-3fae72b9-78ec-49c7-a133-10829be6b2c7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.075070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] The token cache is being invalidate because project 9fdbd111608f404eba427ac74dff84d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:57.075354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.076004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.077532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1134/2313] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:56 2021] DELETE /identity/v3/projects/9fdbd111608f404eba427ac74dff84d4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:57.081511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:57.092713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6fe4f-2974-42dc-aa45-4a355a70d2dc service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:57.147690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:57.148569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:57.148850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:57.149122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] PATH_INFO: `/v3/users/2e69debc93124a1f8ccb08b9ce0b10a3` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:57.150348 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e69debc93124a1f8ccb08b9ce0b10a3)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:57.152311 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:57.437492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e69debc93124a1f8ccb08b9ce0b10a3'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.437492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e69debc93124a1f8ccb08b9ce0b10a3'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.438098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e69debc93124a1f8ccb08b9ce0b10a3'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.526223 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e69debc93124a1f8ccb08b9ce0b10a3'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.541262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-21add044-084f-4661-b6f1-05646a0c0b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e69debc93124a1f8ccb08b9ce0b10a3'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:57.560939 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1180/2314] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:57 2021] DELETE /identity/v3/users/2e69debc93124a1f8ccb08b9ce0b10a3 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:58.033216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:58.035537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:58.056835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae72b9-78ec-49c7-a133-10829be6b2c7 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:58.114974 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:58.115935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.116173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.116406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] PATH_INFO: `/v3/projects/c8d36915928d444999cdc421765ba5be` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.117635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d36915928d444999cdc421765ba5be)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:58.119651 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:58.231632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d36915928d444999cdc421765ba5be', 'request_id': 'req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:58.309685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d36915928d444999cdc421765ba5be', 'request_id': 'req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:58.315841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d36915928d444999cdc421765ba5be', 'request_id': 'req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:58.329295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] The token cache is being invalidate because project c8d36915928d444999cdc421765ba5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:15:58.329778 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:58.330632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2116eaa-cce6-43aa-ad9f-1d853a52ca3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:58.332181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1135/2315] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:15:58 2021] DELETE /identity/v3/projects/c8d36915928d444999cdc421765ba5be => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:15:58.338239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6ed6-8f01-4c71-841c-4b3de1d51d75 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.338903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6ed6-8f01-4c71-841c-4b3de1d51d75 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.339194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6ed6-8f01-4c71-841c-4b3de1d51d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.359936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-210d6ed6-8f01-4c71-841c-4b3de1d51d75 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:58.369430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-210d6ed6-8f01-4c71-841c-4b3de1d51d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:58.441482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1181/2316] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:58.447633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768728aa-14d3-4426-98d6-61bd0b017ee7 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.447922 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768728aa-14d3-4426-98d6-61bd0b017ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.448209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768728aa-14d3-4426-98d6-61bd0b017ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.479943 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-768728aa-14d3-4426-98d6-61bd0b017ee7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:58.485309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-768728aa-14d3-4426-98d6-61bd0b017ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:58.502595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1136/2317] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:58.505797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d6ed6-8f01-4c71-841c-4b3de1d51d75 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:58.516064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d6ed6-8f01-4c71-841c-4b3de1d51d75 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:58.522903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:58.522903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.522903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.523173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.523764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:15:58.529657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:58.531405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:58.550025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1182/2318] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:15:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:15:58.553076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768728aa-14d3-4426-98d6-61bd0b017ee7 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:58.562986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768728aa-14d3-4426-98d6-61bd0b017ee7 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:58.567640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ad0f-46b1-4167-ba3d-09349e40b961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:58.568299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ad0f-46b1-4167-ba3d-09349e40b961 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.568578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ad0f-46b1-4167-ba3d-09349e40b961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.568872 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ad0f-46b1-4167-ba3d-09349e40b961 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.569581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ad0f-46b1-4167-ba3d-09349e40b961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:58.571518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ad0f-46b1-4167-ba3d-09349e40b961 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:58.660228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1137/2319] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:15:58 2021] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:58.667131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:58.677696 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e66b8-f193-42b4-872e-acb8e6796d62 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:58.743376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e76d8b-5bd4-437a-8004-aafa4b3f94d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:58.745106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e76d8b-5bd4-437a-8004-aafa4b3f94d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.745106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e76d8b-5bd4-437a-8004-aafa4b3f94d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.745106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e76d8b-5bd4-437a-8004-aafa4b3f94d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.745586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e76d8b-5bd4-437a-8004-aafa4b3f94d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:58.748054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e76d8b-5bd4-437a-8004-aafa4b3f94d5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:58.818287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1183/2320] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:15:58 2021] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:15:58.823422 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ad0f-46b1-4167-ba3d-09349e40b961 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:58.834389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ad0f-46b1-4167-ba3d-09349e40b961 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:58.839496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:58.840407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.840695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.840965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.856454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:58.856454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:58.861820 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1138/2321] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:58.862879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e76d8b-5bd4-437a-8004-aafa4b3f94d5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:58.873274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:58.875262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:58.878390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e76d8b-5bd4-437a-8004-aafa4b3f94d5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:58.886518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39fd27-4e3a-4f33-add4-fd369a82465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:58.887709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39fd27-4e3a-4f33-add4-fd369a82465c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.890257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39fd27-4e3a-4f33-add4-fd369a82465c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.890257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39fd27-4e3a-4f33-add4-fd369a82465c admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.890465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76adb39-1ec8-4546-868d-cba7a37bfd72 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:58.890606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39fd27-4e3a-4f33-add4-fd369a82465c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:58.893118 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39fd27-4e3a-4f33-add4-fd369a82465c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:58.895078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:58.896192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.896544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.896885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] PATH_INFO: `/v3/users/95d912a459df4fc59387ed9be12fb6b9` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.898351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d912a459df4fc59387ed9be12fb6b9)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:58.900619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:58.906882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1184/2322] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:15:58.910392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39fd27-4e3a-4f33-add4-fd369a82465c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:58.929954 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39fd27-4e3a-4f33-add4-fd369a82465c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:58.936384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e350f-9340-42fc-aa72-821900967feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:58.937694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e350f-9340-42fc-aa72-821900967feb admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:58.937974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e350f-9340-42fc-aa72-821900967feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:58.938245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e350f-9340-42fc-aa72-821900967feb admin admin] PATH_INFO: `/v3/projects/aa13744396cb4626a4974a73d0afcd2e/users/46ff990ca6534fe1bf56235b2e8f8514/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:58.955281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e350f-9340-42fc-aa72-821900967feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa13744396cb4626a4974a73d0afcd2e, user_id=46ff990ca6534fe1bf56235b2e8f8514, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:58.959003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e350f-9340-42fc-aa72-821900967feb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:59.061782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1185/2323] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:15:58 2021] PUT /identity/v3/projects/aa13744396cb4626a4974a73d0afcd2e/users/46ff990ca6534fe1bf56235b2e8f8514/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:59.076230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1296a-5203-4fab-9799-0cf30eae418f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:59.076517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1296a-5203-4fab-9799-0cf30eae418f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:59.076789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1296a-5203-4fab-9799-0cf30eae418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:59.099258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d912a459df4fc59387ed9be12fb6b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:59.100467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d912a459df4fc59387ed9be12fb6b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:59.101092 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d912a459df4fc59387ed9be12fb6b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:59.104727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-82a1296a-5203-4fab-9799-0cf30eae418f None None] MFA Rules not processed for user `46ff990ca6534fe1bf56235b2e8f8514`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:59.106493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-82a1296a-5203-4fab-9799-0cf30eae418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:59.174093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1186/2324] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:59 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:15:59.191719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d912a459df4fc59387ed9be12fb6b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:59.202045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1296a-5203-4fab-9799-0cf30eae418f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:59.202045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-82a1296a-5203-4fab-9799-0cf30eae418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:59.228262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-48df16bb-3d6d-4f8f-8f5f-6c66ab655d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d912a459df4fc59387ed9be12fb6b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:15:59.249258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1139/2325] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:15:58 2021] DELETE /identity/v3/users/95d912a459df4fc59387ed9be12fb6b9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:15:59.250618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62704-7dd6-4a5a-835a-af533c0ca639 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:59.250928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62704-7dd6-4a5a-835a-af533c0ca639 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:59.251201 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a62704-7dd6-4a5a-835a-af533c0ca639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:59.270842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-51a62704-7dd6-4a5a-835a-af533c0ca639 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:15:59.273213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-51a62704-7dd6-4a5a-835a-af533c0ca639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:59.282029 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1296a-5203-4fab-9799-0cf30eae418f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:59.334715 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1140/2326] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:15:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:15:59.341875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:59.342768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:59.343056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:59.343340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:59.346202 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a62704-7dd6-4a5a-835a-af533c0ca639 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:15:59.347868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-51a62704-7dd6-4a5a-835a-af533c0ca639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:15:59.412457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:59.414282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a62704-7dd6-4a5a-835a-af533c0ca639 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:15:59.414435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:59.418735 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff60ec-32dc-4f7c-8575-7af33114428e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:15:59.419782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff60ec-32dc-4f7c-8575-7af33114428e service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:15:59.420207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff60ec-32dc-4f7c-8575-7af33114428e service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:15:59.420479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff60ec-32dc-4f7c-8575-7af33114428e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:15:59.424484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1187/2327] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:59 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:15:59.430579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff60ec-32dc-4f7c-8575-7af33114428e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:15:59.432062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff60ec-32dc-4f7c-8575-7af33114428e service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:15:59.443686 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1141/2328] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:15:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:16:00.159328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:00.161414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:00.193578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e81fb-884b-48cd-b604-169195449b1d service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:00.194888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:00.195829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:00.196166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:00.196443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] PATH_INFO: `/v3/projects/cc04429abe7547a092e4a3147034fbc7` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:00.197673 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc04429abe7547a092e4a3147034fbc7)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:00.199736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:00.384354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc04429abe7547a092e4a3147034fbc7', 'request_id': 'req-dd8939e3-db00-477f-a147-f9aa1624d89d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.509289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc04429abe7547a092e4a3147034fbc7', 'request_id': 'req-dd8939e3-db00-477f-a147-f9aa1624d89d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.515725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc04429abe7547a092e4a3147034fbc7', 'request_id': 'req-dd8939e3-db00-477f-a147-f9aa1624d89d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.526718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] The token cache is being invalidate because project cc04429abe7547a092e4a3147034fbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:00.527008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.528176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.530879 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1188/2329] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:00 2021] DELETE /identity/v3/projects/cc04429abe7547a092e4a3147034fbc7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:00.534844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff60ec-32dc-4f7c-8575-7af33114428e service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:00.545342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff60ec-32dc-4f7c-8575-7af33114428e service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:00.613620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:00.616676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:00.616959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:00.617248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] PATH_INFO: `/v3/users/6939270a837f4e8a99980c297a338908` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:00.618657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6939270a837f4e8a99980c297a338908)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:00.620801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:00.821227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6939270a837f4e8a99980c297a338908'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.821926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6939270a837f4e8a99980c297a338908'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.822624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6939270a837f4e8a99980c297a338908'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.908769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6939270a837f4e8a99980c297a338908'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.922132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6939270a837f4e8a99980c297a338908'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:00.936671 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1142/2330] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:00 2021] DELETE /identity/v3/users/6939270a837f4e8a99980c297a338908 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:01.132422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:01.134302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:01.148720 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8939e3-db00-477f-a147-f9aa1624d89d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:01.227040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:01.228091 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:01.228365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:01.228896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] PATH_INFO: `/v3/users/b3e095b10247471bb2521bb73b700205` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:01.230303 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e095b10247471bb2521bb73b700205)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:01.232477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:01.463750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:01.465688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:01.509736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e40b23-53f0-46a9-9665-937a96e62b9c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:01.516011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:01.517504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:01.517504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:01.517504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] PATH_INFO: `/v3/projects/ee984ee1cf584ea48589ccde4b70eba1` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:01.518811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee984ee1cf584ea48589ccde4b70eba1)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:01.520753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:01.584922 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e095b10247471bb2521bb73b700205'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.586882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e095b10247471bb2521bb73b700205'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.587932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e095b10247471bb2521bb73b700205'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.653788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee984ee1cf584ea48589ccde4b70eba1', 'request_id': 'req-c0c4eb75-a217-437e-be44-8c10874d277f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.658352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e095b10247471bb2521bb73b700205'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.675074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e095b10247471bb2521bb73b700205'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.691605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1189/2331] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:01 2021] DELETE /identity/v3/users/b3e095b10247471bb2521bb73b700205 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:01.695064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:01.695064 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:01.773870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396df17-fa03-4e64-b712-1d46f9d46a78 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:01.779168 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:01.780094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:01.780371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:01.780638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] PATH_INFO: `/v3/users/2636892525874d15bf28bf913d147ecd` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:01.781972 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2636892525874d15bf28bf913d147ecd)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:01.783948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:01.785087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee984ee1cf584ea48589ccde4b70eba1', 'request_id': 'req-c0c4eb75-a217-437e-be44-8c10874d277f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.794590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee984ee1cf584ea48589ccde4b70eba1', 'request_id': 'req-c0c4eb75-a217-437e-be44-8c10874d277f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.817246 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] The token cache is being invalidate because project ee984ee1cf584ea48589ccde4b70eba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:01.817703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.818713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-c0c4eb75-a217-437e-be44-8c10874d277f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:01.821193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1143/2332] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:01 2021] DELETE /identity/v3/projects/ee984ee1cf584ea48589ccde4b70eba1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:01.823680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8723b-69e7-4a82-b39a-cbcf722b1f35 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:01.824757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8723b-69e7-4a82-b39a-cbcf722b1f35 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:01.824757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8723b-69e7-4a82-b39a-cbcf722b1f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:01.851006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c9d8723b-69e7-4a82-b39a-cbcf722b1f35 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:01.852224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c9d8723b-69e7-4a82-b39a-cbcf722b1f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:01.861118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1144/2333] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:01.862413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5f92-905d-40d7-a442-c726dab24c2a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:01.862727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5f92-905d-40d7-a442-c726dab24c2a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:01.863002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a5f92-905d-40d7-a442-c726dab24c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:01.882716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-089a5f92-905d-40d7-a442-c726dab24c2a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:01.884113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-089a5f92-905d-40d7-a442-c726dab24c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:01.900680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1145/2334] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:01.900680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a5f92-905d-40d7-a442-c726dab24c2a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:01.900680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-089a5f92-905d-40d7-a442-c726dab24c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:01.956532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a5f92-905d-40d7-a442-c726dab24c2a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:01.960813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4acd94-4b5d-4fd6-b563-db024a37629f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:01.961476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4acd94-4b5d-4fd6-b563-db024a37629f service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:01.961756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4acd94-4b5d-4fd6-b563-db024a37629f service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:01.962074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4acd94-4b5d-4fd6-b563-db024a37629f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:01.975346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4acd94-4b5d-4fd6-b563-db024a37629f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:01.975346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4acd94-4b5d-4fd6-b563-db024a37629f service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:01.988334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1146/2335] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:01.989979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fd4f2-729b-41e0-84f6-1eb3ab61fab9 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:01.990274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fd4f2-729b-41e0-84f6-1eb3ab61fab9 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:01.990712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fd4f2-729b-41e0-84f6-1eb3ab61fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.010122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-fc8fd4f2-729b-41e0-84f6-1eb3ab61fab9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:02.011149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2636892525874d15bf28bf913d147ecd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:02.011455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fc8fd4f2-729b-41e0-84f6-1eb3ab61fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:02.012146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2636892525874d15bf28bf913d147ecd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:02.013109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2636892525874d15bf28bf913d147ecd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:02.025242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1147/2336] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:02.032055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fd4f2-729b-41e0-84f6-1eb3ab61fab9 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:02.047131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fd4f2-729b-41e0-84f6-1eb3ab61fab9 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:02.053189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:02.054111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.054598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.055065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.055853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:02.056167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:02.057796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:02.076138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1148/2337] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:16:02.079786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:02.089826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2636892525874d15bf28bf913d147ecd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:02.125711 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537f11-1674-4bca-bd26-15d2d9f657c4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:02.131148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1bde9887-f7ab-4368-bc6d-9805bc9f7ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2636892525874d15bf28bf913d147ecd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:02.132338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8de18-fbec-4c33-aabe-520420a64f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:02.134061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8de18-fbec-4c33-aabe-520420a64f3b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.134589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8de18-fbec-4c33-aabe-520420a64f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.135174 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8de18-fbec-4c33-aabe-520420a64f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.135713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8de18-fbec-4c33-aabe-520420a64f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:02.138668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8de18-fbec-4c33-aabe-520420a64f3b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:02.163531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1190/2338] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:01 2021] DELETE /identity/v3/users/2636892525874d15bf28bf913d147ecd => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:02.174892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f3aa-a291-4c21-bcf4-dc9a69d03cab None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.175343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f3aa-a291-4c21-bcf4-dc9a69d03cab None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.175883 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f3aa-a291-4c21-bcf4-dc9a69d03cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.202144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-63f6f3aa-a291-4c21-bcf4-dc9a69d03cab None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:02.203857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-63f6f3aa-a291-4c21-bcf4-dc9a69d03cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:02.286226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1191/2339] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:02.307364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f3aa-a291-4c21-bcf4-dc9a69d03cab None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:02.311583 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1149/2340] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:02 2021] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:02.311822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-63f6f3aa-a291-4c21-bcf4-dc9a69d03cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:02.312728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8de18-fbec-4c33-aabe-520420a64f3b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:02.382287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f3aa-a291-4c21-bcf4-dc9a69d03cab None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:02.391572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8de18-fbec-4c33-aabe-520420a64f3b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:02.412518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782ee3a-4cd5-4e5a-baf3-81d45a806cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:02.412518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782ee3a-4cd5-4e5a-baf3-81d45a806cea admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.412518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782ee3a-4cd5-4e5a-baf3-81d45a806cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.412518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782ee3a-4cd5-4e5a-baf3-81d45a806cea admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.413251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782ee3a-4cd5-4e5a-baf3-81d45a806cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:02.413251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782ee3a-4cd5-4e5a-baf3-81d45a806cea admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:02.448403 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edbacb-94e2-4829-9a7b-05140eca273b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:02.449100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edbacb-94e2-4829-9a7b-05140eca273b service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.461528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edbacb-94e2-4829-9a7b-05140eca273b service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.461528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edbacb-94e2-4829-9a7b-05140eca273b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.461528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edbacb-94e2-4829-9a7b-05140eca273b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:02.462968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edbacb-94e2-4829-9a7b-05140eca273b service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:02.474878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1192/2341] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:02.583856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1150/2342] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:02 2021] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:02.589558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edbacb-94e2-4829-9a7b-05140eca273b service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:02.600346 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edbacb-94e2-4829-9a7b-05140eca273b service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:02.605441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:02.606102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.606528 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.606862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.607565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:02.609160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:02.620159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1193/2343] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:16:02.625005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782ee3a-4cd5-4e5a-baf3-81d45a806cea admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:02.636564 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782ee3a-4cd5-4e5a-baf3-81d45a806cea admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:02.638271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:02.640146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:02.642516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73185375-5fe6-4b50-807f-9ad97489696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:02.643624 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73185375-5fe6-4b50-807f-9ad97489696b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.643920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73185375-5fe6-4b50-807f-9ad97489696b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.646658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73185375-5fe6-4b50-807f-9ad97489696b admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.646658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73185375-5fe6-4b50-807f-9ad97489696b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:02.647953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73185375-5fe6-4b50-807f-9ad97489696b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:02.674035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1151/2344] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:02.677397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74aeb-0c3f-417f-8dfc-54937b15d844 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:02.689555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:02.689927 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.690184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73185375-5fe6-4b50-807f-9ad97489696b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:02.690494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.691450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] PATH_INFO: `/v3/projects/b608061172d640d5ac7b5df94eb98243` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.696077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b608061172d640d5ac7b5df94eb98243)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:02.701726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:02.714291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73185375-5fe6-4b50-807f-9ad97489696b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:02.721162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afe50b-12d1-4940-81eb-db2e8cca3656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:02.722499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afe50b-12d1-4940-81eb-db2e8cca3656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.722992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afe50b-12d1-4940-81eb-db2e8cca3656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.723419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afe50b-12d1-4940-81eb-db2e8cca3656 admin admin] PATH_INFO: `/v3/projects/6c607062535548eba245a09731a59175/users/7286b79430fb4bfd9000f2551f9f228e/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.747014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afe50b-12d1-4940-81eb-db2e8cca3656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c607062535548eba245a09731a59175, user_id=7286b79430fb4bfd9000f2551f9f228e, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:02.749711 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afe50b-12d1-4940-81eb-db2e8cca3656 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:02.842676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1152/2345] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:02 2021] PUT /identity/v3/projects/6c607062535548eba245a09731a59175/users/7286b79430fb4bfd9000f2551f9f228e/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:02.848968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8d26-e56a-481c-903b-3730edffaa78 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:02.849419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8d26-e56a-481c-903b-3730edffaa78 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:02.849709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8d26-e56a-481c-903b-3730edffaa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:02.874605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b608061172d640d5ac7b5df94eb98243', 'request_id': 'req-15edc14c-6c62-4401-a165-1e9596dc5587'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:02.898602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-280b8d26-e56a-481c-903b-3730edffaa78 None None] MFA Rules not processed for user `7286b79430fb4bfd9000f2551f9f228e`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:02.899927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-280b8d26-e56a-481c-903b-3730edffaa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:02.985164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b608061172d640d5ac7b5df94eb98243', 'request_id': 'req-15edc14c-6c62-4401-a165-1e9596dc5587'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:02.995382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b608061172d640d5ac7b5df94eb98243', 'request_id': 'req-15edc14c-6c62-4401-a165-1e9596dc5587'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.007007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1153/2346] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:02 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:03.007949 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b8d26-e56a-481c-903b-3730edffaa78 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.016537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] The token cache is being invalidate because project b608061172d640d5ac7b5df94eb98243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:03.016829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.018227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-15edc14c-6c62-4401-a165-1e9596dc5587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.022868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1194/2347] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:02 2021] DELETE /identity/v3/projects/b608061172d640d5ac7b5df94eb98243 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:03.032951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a2df5-2f30-4a41-9a74-08762636582e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.033658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a2df5-2f30-4a41-9a74-08762636582e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.033858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a2df5-2f30-4a41-9a74-08762636582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.066586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-777a2df5-2f30-4a41-9a74-08762636582e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:03.070129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-777a2df5-2f30-4a41-9a74-08762636582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.105034 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b8d26-e56a-481c-903b-3730edffaa78 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.115344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc170-e5bd-4d62-b95b-a0fa1dabb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.116016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc170-e5bd-4d62-b95b-a0fa1dabb0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.116296 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc170-e5bd-4d62-b95b-a0fa1dabb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.116568 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc170-e5bd-4d62-b95b-a0fa1dabb0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.117272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbc170-e5bd-4d62-b95b-a0fa1dabb0d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.119325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbc170-e5bd-4d62-b95b-a0fa1dabb0d0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.141540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1195/2348] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:03.149595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a85ab-0853-49c9-a5cd-2dbcfecb11f4 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.149882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a85ab-0853-49c9-a5cd-2dbcfecb11f4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.150156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a85ab-0853-49c9-a5cd-2dbcfecb11f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.171668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dc9a85ab-0853-49c9-a5cd-2dbcfecb11f4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:03.172916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dc9a85ab-0853-49c9-a5cd-2dbcfecb11f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.191518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1196/2349] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:03.191518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a85ab-0853-49c9-a5cd-2dbcfecb11f4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.192214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dc9a85ab-0853-49c9-a5cd-2dbcfecb11f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.204951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a85ab-0853-49c9-a5cd-2dbcfecb11f4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.210166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.216067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.216067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.216067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] PATH_INFO: `/v3/projects/160f3377b4d74251a6bc4363faca7e89` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.216067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=160f3377b4d74251a6bc4363faca7e89)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.216067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.242154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1154/2350] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:03 2021] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:03.244746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc170-e5bd-4d62-b95b-a0fa1dabb0d0 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.345550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc170-e5bd-4d62-b95b-a0fa1dabb0d0 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.357149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.357994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.358901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.359113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.360260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:03.360654 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.363104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.378709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1155/2351] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:16:03.379829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.382512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.398670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160f3377b4d74251a6bc4363faca7e89', 'request_id': 'req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.406398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56213ec4-851c-4ffc-a4d7-62cc1ccb7d0b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.486148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.487091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.487228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.487487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.488255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.490593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.492787 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160f3377b4d74251a6bc4363faca7e89', 'request_id': 'req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.505700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160f3377b4d74251a6bc4363faca7e89', 'request_id': 'req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.526975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] The token cache is being invalidate because project 160f3377b4d74251a6bc4363faca7e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:03.527224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.528395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.529949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1197/2352] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:03 2021] DELETE /identity/v3/projects/160f3377b4d74251a6bc4363faca7e89 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:03.530718 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.532098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.545802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ae50-e485-4abf-b45a-e3ec6b5d2b71 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.550687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.551335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.551620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.551896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.552594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.554516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.610802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1156/2353] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:03 2021] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:03.610802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.610802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.622813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f15f05-6aeb-44a0-9787-af627a11f250 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.627449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.628302 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.633456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.633456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] PATH_INFO: `/v3/users/da7841ddd625483888d8741c5f0461b7` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.633456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7841ddd625483888d8741c5f0461b7)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.633456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.696968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1198/2354] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:03 2021] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:03.696968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.696968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.767711 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ccb58-afbe-4757-8b77-88f2af70429f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.776546 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029a841-8322-4f26-b81a-eea77fc30307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.777234 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029a841-8322-4f26-b81a-eea77fc30307 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.778096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029a841-8322-4f26-b81a-eea77fc30307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.778418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029a841-8322-4f26-b81a-eea77fc30307 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.779215 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029a841-8322-4f26-b81a-eea77fc30307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.780905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029a841-8322-4f26-b81a-eea77fc30307 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.793432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1199/2355] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:03 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:03.796418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029a841-8322-4f26-b81a-eea77fc30307 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.796681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7841ddd625483888d8741c5f0461b7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.797126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7841ddd625483888d8741c5f0461b7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.798685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7841ddd625483888d8741c5f0461b7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.807996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029a841-8322-4f26-b81a-eea77fc30307 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.813761 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.814649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.815270 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.815698 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.816680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.819465 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.863145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7841ddd625483888d8741c5f0461b7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.879053 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7841ddd625483888d8741c5f0461b7'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:03.891679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1157/2356] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:03 2021] DELETE /identity/v3/users/da7841ddd625483888d8741c5f0461b7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:03.892620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.893943 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.938436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1200/2357] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:03 2021] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:03.942964 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.952483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:03.958182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e1baf-2606-43c4-ab3e-7c5d7ef6511d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.963241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a66ac3-a4ac-49c1-a874-1bce3d0840ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.964061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66ac3-a4ac-49c1-a874-1bce3d0840ba admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.964389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66ac3-a4ac-49c1-a874-1bce3d0840ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.964584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66ac3-a4ac-49c1-a874-1bce3d0840ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.966679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a66ac3-a4ac-49c1-a874-1bce3d0840ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.970758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a66ac3-a4ac-49c1-a874-1bce3d0840ba admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:03.971003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cfd11-5e90-4d1d-9022-0d1d12ee53ba admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:03.986694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1201/2358] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:03 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:16:03.988010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ba8e1-bad6-4061-b054-60382a4bb10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:03.988845 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba8e1-bad6-4061-b054-60382a4bb10e admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:03.989099 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba8e1-bad6-4061-b054-60382a4bb10e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:03.989580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba8e1-bad6-4061-b054-60382a4bb10e admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:03.991131 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ba8e1-bad6-4061-b054-60382a4bb10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:03.991756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a66ac3-a4ac-49c1-a874-1bce3d0840ba admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:03.992782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ba8e1-bad6-4061-b054-60382a4bb10e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.005033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a66ac3-a4ac-49c1-a874-1bce3d0840ba admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:04.013244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cb020-5389-4416-bda8-2182c421d6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:04.013457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb020-5389-4416-bda8-2182c421d6ad admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.013770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb020-5389-4416-bda8-2182c421d6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.020850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1158/2359] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:03 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:04.020982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb020-5389-4416-bda8-2182c421d6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.020982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cb020-5389-4416-bda8-2182c421d6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:04.020982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cb020-5389-4416-bda8-2182c421d6ad admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.022755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ba8e1-bad6-4061-b054-60382a4bb10e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:04.031092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1202/2360] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:03 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:04.034657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ba8e1-bad6-4061-b054-60382a4bb10e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:04.035635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cb020-5389-4416-bda8-2182c421d6ad admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:04.040204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbe38a-0e81-49ee-a3e1-9cd1d4ed2da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:04.040504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe38a-0e81-49ee-a3e1-9cd1d4ed2da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.040780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe38a-0e81-49ee-a3e1-9cd1d4ed2da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.045200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe38a-0e81-49ee-a3e1-9cd1d4ed2da1 admin admin] PATH_INFO: `/v3/projects/84f177f15b8a4712ab2685c711923771/users/df5e59d2d1544783a895535ae4024fbb/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.046337 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cb020-5389-4416-bda8-2182c421d6ad admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:04.051198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbf55d-186c-4f33-afb1-94facbf721a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:04.052136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbf55d-186c-4f33-afb1-94facbf721a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.052409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbf55d-186c-4f33-afb1-94facbf721a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.052684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbf55d-186c-4f33-afb1-94facbf721a9 admin admin] PATH_INFO: `/v3/projects/10bedfb35d1e481aa78e025489c1be2d/users/97c82e393b164313ad7a95eca6b65c26/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.057637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbe38a-0e81-49ee-a3e1-9cd1d4ed2da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f177f15b8a4712ab2685c711923771, user_id=df5e59d2d1544783a895535ae4024fbb, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:04.060502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbe38a-0e81-49ee-a3e1-9cd1d4ed2da1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.067978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbf55d-186c-4f33-afb1-94facbf721a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bedfb35d1e481aa78e025489c1be2d, user_id=97c82e393b164313ad7a95eca6b65c26, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:04.070678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbf55d-186c-4f33-afb1-94facbf721a9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.139358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1159/2361] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:04 2021] PUT /identity/v3/projects/84f177f15b8a4712ab2685c711923771/users/df5e59d2d1544783a895535ae4024fbb/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:04.153216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31160c4-a94d-4138-9e67-601d033b2a9e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.159967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31160c4-a94d-4138-9e67-601d033b2a9e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.159967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31160c4-a94d-4138-9e67-601d033b2a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.190859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b31160c4-a94d-4138-9e67-601d033b2a9e None None] MFA Rules not processed for user `df5e59d2d1544783a895535ae4024fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:04.192204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b31160c4-a94d-4138-9e67-601d033b2a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:04.218451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1203/2362] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:04 2021] PUT /identity/v3/projects/10bedfb35d1e481aa78e025489c1be2d/users/97c82e393b164313ad7a95eca6b65c26/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:04.234416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b88c2-2d5a-42fe-b26c-80fe34245b9e None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.234848 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b88c2-2d5a-42fe-b26c-80fe34245b9e None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.235279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b88c2-2d5a-42fe-b26c-80fe34245b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.262461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e39b88c2-2d5a-42fe-b26c-80fe34245b9e None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:04.265521 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e39b88c2-2d5a-42fe-b26c-80fe34245b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:04.286349 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1160/2363] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:04 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:04.288183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31160c4-a94d-4138-9e67-601d033b2a9e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:04.346100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1204/2364] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:04.353111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b88c2-2d5a-42fe-b26c-80fe34245b9e None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:04.354874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e39b88c2-2d5a-42fe-b26c-80fe34245b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:04.406381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31160c4-a94d-4138-9e67-601d033b2a9e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:04.427318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:04.428022 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.428301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.428569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.431941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:04.434453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.481805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b88c2-2d5a-42fe-b26c-80fe34245b9e None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:04.487539 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:04.488323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.492278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.492278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.500313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:04.501978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.517797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1205/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:04.520318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:04.524495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:04.557625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500f637-ef1e-4d68-8a09-70a1d300c6af service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:04.572430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:04.573490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.573827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.574155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] PATH_INFO: `/v3/projects/3872320b9aff4e35b14f27d0011d11ef` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.575804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3872320b9aff4e35b14f27d0011d11ef)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:04.577952 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.624316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1161/2366] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:04 2021] POST /identity/v3/projects => generated 377 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:16:04.625773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:04.628285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:04.711325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a3631-69a3-419e-870d-23e30cd61cf5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:04.716804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:04.718323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.718718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.719063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] PATH_INFO: `/v3/users/dcc15198eff24ea999cb55f8d6655cb9` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.721188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc15198eff24ea999cb55f8d6655cb9)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:04.723502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.743293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3872320b9aff4e35b14f27d0011d11ef', 'request_id': 'req-550370c4-4161-4dc0-8957-50d598081659'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:04.800206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3872320b9aff4e35b14f27d0011d11ef', 'request_id': 'req-550370c4-4161-4dc0-8957-50d598081659'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:04.806454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3872320b9aff4e35b14f27d0011d11ef', 'request_id': 'req-550370c4-4161-4dc0-8957-50d598081659'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:04.818622 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] The token cache is being invalidate because project 3872320b9aff4e35b14f27d0011d11ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:04.818908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:04.819564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:04.821092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1206/2367] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:04 2021] DELETE /identity/v3/projects/3872320b9aff4e35b14f27d0011d11ef => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:04.825767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:04.827106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:04.892115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550370c4-4161-4dc0-8957-50d598081659 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:04.899300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ba476-2a6b-4382-a00f-3713782a919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:04.900214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ba476-2a6b-4382-a00f-3713782a919e admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:04.900440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ba476-2a6b-4382-a00f-3713782a919e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:04.900533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ba476-2a6b-4382-a00f-3713782a919e admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:04.901201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ba476-2a6b-4382-a00f-3713782a919e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:04.903975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ba476-2a6b-4382-a00f-3713782a919e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:04.977362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc15198eff24ea999cb55f8d6655cb9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:04.978295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc15198eff24ea999cb55f8d6655cb9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:04.978929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc15198eff24ea999cb55f8d6655cb9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:04.997890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1207/2368] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:04 2021] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:05.001270 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a6fa-90d2-4628-9a90-a4d4fbde0bbf None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.002095 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a6fa-90d2-4628-9a90-a4d4fbde0bbf None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.007029 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7a6fa-90d2-4628-9a90-a4d4fbde0bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.032600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-00d7a6fa-90d2-4628-9a90-a4d4fbde0bbf None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:05.033869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-00d7a6fa-90d2-4628-9a90-a4d4fbde0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:05.042825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1208/2369] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:05.043139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7a6fa-90d2-4628-9a90-a4d4fbde0bbf None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.045023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-00d7a6fa-90d2-4628-9a90-a4d4fbde0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:05.052018 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc15198eff24ea999cb55f8d6655cb9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:05.056945 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7a6fa-90d2-4628-9a90-a4d4fbde0bbf None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:05.063921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69373d00-8479-4ecf-9ddd-81853d7273a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:05.064913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373d00-8479-4ecf-9ddd-81853d7273a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.065190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373d00-8479-4ecf-9ddd-81853d7273a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.065459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373d00-8479-4ecf-9ddd-81853d7273a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.066260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69373d00-8479-4ecf-9ddd-81853d7273a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:05.067957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69373d00-8479-4ecf-9ddd-81853d7273a5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:05.068603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fe9ad6e0-d48f-47a8-bda2-0bcdd077d753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc15198eff24ea999cb55f8d6655cb9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:05.081806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1162/2370] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:04 2021] DELETE /identity/v3/users/dcc15198eff24ea999cb55f8d6655cb9 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:05.086272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1209/2371] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:05 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:05.086782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd18bae-33dd-4f38-81e7-357da44807a7 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.086782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd18bae-33dd-4f38-81e7-357da44807a7 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.086782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd18bae-33dd-4f38-81e7-357da44807a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.087032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1d22-99fd-4ae4-9586-3ee551376ae6 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.087366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1d22-99fd-4ae4-9586-3ee551376ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.087891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1d22-99fd-4ae4-9586-3ee551376ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.104213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1bd18bae-33dd-4f38-81e7-357da44807a7 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:05.105432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1bd18bae-33dd-4f38-81e7-357da44807a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:05.111623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ef9d1d22-99fd-4ae4-9586-3ee551376ae6 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:05.112918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ef9d1d22-99fd-4ae4-9586-3ee551376ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:05.185893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1163/2372] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:05.187079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1210/2373] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:05.190577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd18bae-33dd-4f38-81e7-357da44807a7 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.196259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1d22-99fd-4ae4-9586-3ee551376ae6 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.201509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd18bae-33dd-4f38-81e7-357da44807a7 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:05.212585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53540d6-85b2-4ce3-ab97-619d86ceeb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:05.213515 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53540d6-85b2-4ce3-ab97-619d86ceeb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.213790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1d22-99fd-4ae4-9586-3ee551376ae6 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:05.213989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53540d6-85b2-4ce3-ab97-619d86ceeb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.216042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53540d6-85b2-4ce3-ab97-619d86ceeb64 admin admin] PATH_INFO: `/v3/projects/9d52787f317446b097c0caab4bf7994b/users/9b6c11f2b5064682be865faf8562ff74/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.225671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:05.226452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.226709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.227104 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.227932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:05.229077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:05.231334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:05.236941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53540d6-85b2-4ce3-ab97-619d86ceeb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d52787f317446b097c0caab4bf7994b, user_id=9b6c11f2b5064682be865faf8562ff74, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:05.238884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53540d6-85b2-4ce3-ab97-619d86ceeb64 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:05.249375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1211/2374] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:16:05.249375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.251568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:05.324905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1164/2375] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:05 2021] PUT /identity/v3/projects/9d52787f317446b097c0caab4bf7994b/users/9b6c11f2b5064682be865faf8562ff74/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:05.325882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53540d6-85b2-4ce3-ab97-619d86ceeb64 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.354344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4572ee-4a4b-4350-877d-6ed1bf040165 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:05.404426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53540d6-85b2-4ce3-ab97-619d86ceeb64 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:05.410449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285c013-f764-41d1-942a-3b8a3a10416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:05.412544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285c013-f764-41d1-942a-3b8a3a10416c admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.412544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285c013-f764-41d1-942a-3b8a3a10416c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.412544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285c013-f764-41d1-942a-3b8a3a10416c admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.412801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285c013-f764-41d1-942a-3b8a3a10416c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:05.414679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285c013-f764-41d1-942a-3b8a3a10416c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:05.422488 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7e6cc-b58f-4e13-ab66-1113e8b7e858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:05.423343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7e6cc-b58f-4e13-ab66-1113e8b7e858 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.423819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7e6cc-b58f-4e13-ab66-1113e8b7e858 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.424173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7e6cc-b58f-4e13-ab66-1113e8b7e858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.435888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7e6cc-b58f-4e13-ab66-1113e8b7e858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:05.439463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7e6cc-b58f-4e13-ab66-1113e8b7e858 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:05.449915 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1212/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:05.450737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7e6cc-b58f-4e13-ab66-1113e8b7e858 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.462514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7e6cc-b58f-4e13-ab66-1113e8b7e858 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:05.469607 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0acfa-b5fb-418c-823b-87202c2019a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:05.469877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0acfa-b5fb-418c-823b-87202c2019a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.470227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0acfa-b5fb-418c-823b-87202c2019a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.470356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0acfa-b5fb-418c-823b-87202c2019a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.471101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0acfa-b5fb-418c-823b-87202c2019a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:05.472783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0acfa-b5fb-418c-823b-87202c2019a8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:05.496349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1213/2377] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:05 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:05.501010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0acfa-b5fb-418c-823b-87202c2019a8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.520189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0acfa-b5fb-418c-823b-87202c2019a8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:05.520810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1165/2378] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:05 2021] POST /identity/v3/projects => generated 369 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:05.526397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285c013-f764-41d1-942a-3b8a3a10416c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.596503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf24b9-3828-402d-b18b-0c4fc549f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:05.597666 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf24b9-3828-402d-b18b-0c4fc549f59a admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.597950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf24b9-3828-402d-b18b-0c4fc549f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.599319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf24b9-3828-402d-b18b-0c4fc549f59a admin admin] PATH_INFO: `/v3/projects/9d52787f317446b097c0caab4bf7994b/users/9b6c11f2b5064682be865faf8562ff74/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.614467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf24b9-3828-402d-b18b-0c4fc549f59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d52787f317446b097c0caab4bf7994b, user_id=9b6c11f2b5064682be865faf8562ff74, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:05.618830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf24b9-3828-402d-b18b-0c4fc549f59a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:05.649338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1214/2379] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:05 2021] PUT /identity/v3/projects/9d52787f317446b097c0caab4bf7994b/users/9b6c11f2b5064682be865faf8562ff74/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:05.661422 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b03f-1c33-4e88-9094-6b6b8e681f54 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.662200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b03f-1c33-4e88-9094-6b6b8e681f54 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.663077 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285c013-f764-41d1-942a-3b8a3a10416c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:05.663245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b03f-1c33-4e88-9094-6b6b8e681f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.705805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b9c0b03f-1c33-4e88-9094-6b6b8e681f54 None None] MFA Rules not processed for user `9b6c11f2b5064682be865faf8562ff74`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:05.707588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b9c0b03f-1c33-4e88-9094-6b6b8e681f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:05.782449 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422a6da-8545-462c-8643-c829c5bbaf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:05.783929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a6da-8545-462c-8643-c829c5bbaf91 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:05.784585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a6da-8545-462c-8643-c829c5bbaf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:05.785376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422a6da-8545-462c-8643-c829c5bbaf91 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:05.787798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422a6da-8545-462c-8643-c829c5bbaf91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:05.791915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422a6da-8545-462c-8643-c829c5bbaf91 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:05.898407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1215/2380] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:05 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:05.909101 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0b03f-1c33-4e88-9094-6b6b8e681f54 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.910748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b9c0b03f-1c33-4e88-9094-6b6b8e681f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:05.929802 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1166/2381] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:05 2021] POST /identity/v3/users => generated 285 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:05.932298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422a6da-8545-462c-8643-c829c5bbaf91 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:05.983261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422a6da-8545-462c-8643-c829c5bbaf91 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:06.003838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a038-0256-4b98-b9e9-8116d1129b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:06.005212 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a038-0256-4b98-b9e9-8116d1129b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:06.005970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a038-0256-4b98-b9e9-8116d1129b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:06.006744 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a038-0256-4b98-b9e9-8116d1129b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:06.008256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a038-0256-4b98-b9e9-8116d1129b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:06.015814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a038-0256-4b98-b9e9-8116d1129b69 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:06.036206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0b03f-1c33-4e88-9094-6b6b8e681f54 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:06.041434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64084f6-03b2-48c1-885c-c8f23e2731c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:06.042259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64084f6-03b2-48c1-885c-c8f23e2731c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:06.042721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64084f6-03b2-48c1-885c-c8f23e2731c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:06.043681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64084f6-03b2-48c1-885c-c8f23e2731c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:06.046252 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e64084f6-03b2-48c1-885c-c8f23e2731c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:06.053490 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1167/2382] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:05 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:06.054956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a038-0256-4b98-b9e9-8116d1129b69 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:06.071558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a038-0256-4b98-b9e9-8116d1129b69 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:06.079376 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bbaa3-e492-4bad-8d37-a9166e134b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:06.080785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbaa3-e492-4bad-8d37-a9166e134b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:06.081334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbaa3-e492-4bad-8d37-a9166e134b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:06.082165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbaa3-e492-4bad-8d37-a9166e134b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:06.083506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bbaa3-e492-4bad-8d37-a9166e134b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:06.091173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bbaa3-e492-4bad-8d37-a9166e134b96 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:06.126849 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1168/2383] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:06 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:06.128316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bbaa3-e492-4bad-8d37-a9166e134b96 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:06.146208 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bbaa3-e492-4bad-8d37-a9166e134b96 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:06.152949 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:06.153898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:06.154180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:06.157682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] PATH_INFO: `/v3/projects/d8ec8bfd803c414caab8708ca2c099c8/users/f3bcc14f317d4265841dc50b8eec5a49/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:06.163145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64084f6-03b2-48c1-885c-c8f23e2731c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:06.169135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64084f6-03b2-48c1-885c-c8f23e2731c3 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:06.181328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1216/2384] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:05 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:06.192147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ec8bfd803c414caab8708ca2c099c8, user_id=f3bcc14f317d4265841dc50b8eec5a49, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:06.196269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:06.305004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1169/2385] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:06 2021] PUT /identity/v3/projects/d8ec8bfd803c414caab8708ca2c099c8/users/f3bcc14f317d4265841dc50b8eec5a49/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:06.323551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c63516-805c-48ad-9122-ffdf6edf9056 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:06.323976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c63516-805c-48ad-9122-ffdf6edf9056 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:06.324411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c63516-805c-48ad-9122-ffdf6edf9056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:06.376947 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a7c63516-805c-48ad-9122-ffdf6edf9056 None None] MFA Rules not processed for user `f3bcc14f317d4265841dc50b8eec5a49`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:06.381194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a7c63516-805c-48ad-9122-ffdf6edf9056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:06.422918 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:06.426108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:06.486477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1217/2386] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:06 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:06.493312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c63516-805c-48ad-9122-ffdf6edf9056 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:06.630561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61218f68-4ae4-4006-ab9d-561123509052 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:06.653402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:06.654297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:06.654707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:06.654917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] PATH_INFO: `/v3/projects/715654fb99884e569362f92c5db2b61a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:06.657240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715654fb99884e569362f92c5db2b61a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:06.659319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:06.676568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c63516-805c-48ad-9122-ffdf6edf9056 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:06.690983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292007f-f9bd-4e29-b392-93df7dece98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:06.691559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292007f-f9bd-4e29-b392-93df7dece98d admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:06.691847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292007f-f9bd-4e29-b392-93df7dece98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:06.692125 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292007f-f9bd-4e29-b392-93df7dece98d admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:06.692846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292007f-f9bd-4e29-b392-93df7dece98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:06.697072 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292007f-f9bd-4e29-b392-93df7dece98d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:06.862656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1218/2387] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:06 2021] POST /identity/v3/projects => generated 369 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:06.863758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292007f-f9bd-4e29-b392-93df7dece98d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:06.899821 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715654fb99884e569362f92c5db2b61a', 'request_id': 'req-1938a89b-84a8-41f0-a5e3-57f9e6288c05'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:06.977683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715654fb99884e569362f92c5db2b61a', 'request_id': 'req-1938a89b-84a8-41f0-a5e3-57f9e6288c05'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:06.987288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715654fb99884e569362f92c5db2b61a', 'request_id': 'req-1938a89b-84a8-41f0-a5e3-57f9e6288c05'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:07.026294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] The token cache is being invalidate because project 715654fb99884e569362f92c5db2b61a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:07.026656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:07.029410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-1938a89b-84a8-41f0-a5e3-57f9e6288c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:07.035520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1170/2388] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:06 2021] DELETE /identity/v3/projects/715654fb99884e569362f92c5db2b61a => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:07.047445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24214-3aea-4d71-93aa-b8fbb34b0ef5 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.047445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24214-3aea-4d71-93aa-b8fbb34b0ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.047445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24214-3aea-4d71-93aa-b8fbb34b0ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.146775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292007f-f9bd-4e29-b392-93df7dece98d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.164963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b7e24214-3aea-4d71-93aa-b8fbb34b0ef5 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:07.168549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b7e24214-3aea-4d71-93aa-b8fbb34b0ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:07.173247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:07.175077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.175519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.175811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.177434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:07.179622 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:07.205997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1171/2389] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:07.215599 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3639f-11e3-45db-ae4e-6b11fe8ed412 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.215915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3639f-11e3-45db-ae4e-6b11fe8ed412 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.216140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3639f-11e3-45db-ae4e-6b11fe8ed412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.260835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-eee3639f-11e3-45db-ae4e-6b11fe8ed412 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:07.285685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-eee3639f-11e3-45db-ae4e-6b11fe8ed412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:07.288823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1219/2390] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:06 2021] POST /identity/v3/users => generated 291 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:07.295216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:07.301682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:07.320872 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1172/2391] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:07.326112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3639f-11e3-45db-ae4e-6b11fe8ed412 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:07.348815 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee445ce-b831-4710-954e-569be9fd5e54 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.353757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3639f-11e3-45db-ae4e-6b11fe8ed412 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.363178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e96f0-5536-43c3-880e-a1e1ceb1216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:07.363960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e96f0-5536-43c3-880e-a1e1ceb1216d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.364280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e96f0-5536-43c3-880e-a1e1ceb1216d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.364558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e96f0-5536-43c3-880e-a1e1ceb1216d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.365513 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e96f0-5536-43c3-880e-a1e1ceb1216d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:07.367265 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e96f0-5536-43c3-880e-a1e1ceb1216d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:07.376612 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:07.377795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.382164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1220/2392] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:07 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:07.383327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e96f0-5536-43c3-880e-a1e1ceb1216d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:07.383906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.384570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.385566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:07.386080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:07.392554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:07.402105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e96f0-5536-43c3-880e-a1e1ceb1216d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.407514 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e008b3-16b3-4520-88fa-52339855386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:07.411851 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1173/2393] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:16:07.412018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e008b3-16b3-4520-88fa-52339855386a admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.412018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e008b3-16b3-4520-88fa-52339855386a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.412018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e008b3-16b3-4520-88fa-52339855386a admin admin] PATH_INFO: `/v3/projects/8136af3ba28e4b46b2b135f3027bc0ca/users/a4dce7a393a84d1ca3fa334dc89c9369/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.413666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:07.437307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf827d9-dd26-43cf-8144-4c13795959ca admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.449147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede86a3-d825-4dc6-8992-59bd8a17a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:07.458235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e008b3-16b3-4520-88fa-52339855386a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8136af3ba28e4b46b2b135f3027bc0ca, user_id=a4dce7a393a84d1ca3fa334dc89c9369, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:07.462299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede86a3-d825-4dc6-8992-59bd8a17a09c admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.462479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e008b3-16b3-4520-88fa-52339855386a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:07.462638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede86a3-d825-4dc6-8992-59bd8a17a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.462883 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede86a3-d825-4dc6-8992-59bd8a17a09c admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.463679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede86a3-d825-4dc6-8992-59bd8a17a09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:07.465827 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede86a3-d825-4dc6-8992-59bd8a17a09c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:07.635249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1221/2394] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:07 2021] PUT /identity/v3/projects/8136af3ba28e4b46b2b135f3027bc0ca/users/a4dce7a393a84d1ca3fa334dc89c9369/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:07.639762 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e008b3-16b3-4520-88fa-52339855386a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:07.647300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1174/2395] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:07 2021] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:07.651687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede86a3-d825-4dc6-8992-59bd8a17a09c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:07.763150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede86a3-d825-4dc6-8992-59bd8a17a09c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.769796 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e5a6-ac99-46fe-8d22-315a97eb01d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:07.770932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e5a6-ac99-46fe-8d22-315a97eb01d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.771509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e5a6-ac99-46fe-8d22-315a97eb01d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.771962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e5a6-ac99-46fe-8d22-315a97eb01d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.772832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954e5a6-ac99-46fe-8d22-315a97eb01d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:07.774039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e008b3-16b3-4520-88fa-52339855386a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.775394 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954e5a6-ac99-46fe-8d22-315a97eb01d3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:07.779684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd0fe-a411-4150-af89-1aa7a05b226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:07.787447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd0fe-a411-4150-af89-1aa7a05b226c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.787447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd0fe-a411-4150-af89-1aa7a05b226c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.787447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd0fe-a411-4150-af89-1aa7a05b226c admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.787447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dd0fe-a411-4150-af89-1aa7a05b226c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:07.787849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dd0fe-a411-4150-af89-1aa7a05b226c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:07.799129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1222/2396] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:07 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:07.803128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd0fe-a411-4150-af89-1aa7a05b226c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:07.816082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd0fe-a411-4150-af89-1aa7a05b226c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.821489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a1fc9-727e-4d44-bdf9-9f1d9c386e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:07.823126 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1fc9-727e-4d44-bdf9-9f1d9c386e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.823409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1fc9-727e-4d44-bdf9-9f1d9c386e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.823679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1fc9-727e-4d44-bdf9-9f1d9c386e6b admin admin] PATH_INFO: `/v3/projects/8136af3ba28e4b46b2b135f3027bc0ca/users/a4dce7a393a84d1ca3fa334dc89c9369/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.825739 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a1fc9-727e-4d44-bdf9-9f1d9c386e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8136af3ba28e4b46b2b135f3027bc0ca, user_id=a4dce7a393a84d1ca3fa334dc89c9369, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:07.828435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a1fc9-727e-4d44-bdf9-9f1d9c386e6b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:07.859345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1223/2397] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:07 2021] PUT /identity/v3/projects/8136af3ba28e4b46b2b135f3027bc0ca/users/a4dce7a393a84d1ca3fa334dc89c9369/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:07.872230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd995-0fa1-4604-8424-35a452b9318b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:07.872629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd995-0fa1-4604-8424-35a452b9318b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:07.873134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd995-0fa1-4604-8424-35a452b9318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:07.877572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1175/2398] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:07 2021] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:16:07.884898 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e5a6-ac99-46fe-8d22-315a97eb01d3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:07.902203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e5a6-ac99-46fe-8d22-315a97eb01d3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:07.929532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-958cd995-0fa1-4604-8424-35a452b9318b None None] MFA Rules not processed for user `a4dce7a393a84d1ca3fa334dc89c9369`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:07.939517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-958cd995-0fa1-4604-8424-35a452b9318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:08.020315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b85b0-aa7c-42d3-8847-8a755e8deba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:08.021251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b85b0-aa7c-42d3-8847-8a755e8deba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:08.021367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b85b0-aa7c-42d3-8847-8a755e8deba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:08.021708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b85b0-aa7c-42d3-8847-8a755e8deba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:08.022383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b85b0-aa7c-42d3-8847-8a755e8deba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:08.024063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b85b0-aa7c-42d3-8847-8a755e8deba1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:08.048774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1176/2399] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:07 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:16:08.051362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b85b0-aa7c-42d3-8847-8a755e8deba1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:08.079070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b85b0-aa7c-42d3-8847-8a755e8deba1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:08.080972 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1224/2400] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:07 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:08.087918 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e973d06-acc4-4dc4-8569-973afb83c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:08.088911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973d06-acc4-4dc4-8569-973afb83c474 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:08.089598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973d06-acc4-4dc4-8569-973afb83c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:08.090650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973d06-acc4-4dc4-8569-973afb83c474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:08.092035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e973d06-acc4-4dc4-8569-973afb83c474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:08.095359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e973d06-acc4-4dc4-8569-973afb83c474 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:08.099590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cd995-0fa1-4604-8424-35a452b9318b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:08.101485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-958cd995-0fa1-4604-8424-35a452b9318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:08.125903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1177/2401] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:08 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:08.129627 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e973d06-acc4-4dc4-8569-973afb83c474 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:08.141062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e973d06-acc4-4dc4-8569-973afb83c474 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:08.153033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27af75b-4f47-4010-a0d3-34030fde6f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:08.154097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27af75b-4f47-4010-a0d3-34030fde6f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:08.154472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27af75b-4f47-4010-a0d3-34030fde6f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:08.161018 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27af75b-4f47-4010-a0d3-34030fde6f17 admin admin] PATH_INFO: `/v3/projects/77909e3d75c949528d10f49c5cadb4ee/users/756be33ce93f49a6bac60d6438a55b90/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:08.203841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27af75b-4f47-4010-a0d3-34030fde6f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77909e3d75c949528d10f49c5cadb4ee, user_id=756be33ce93f49a6bac60d6438a55b90, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:08.206674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27af75b-4f47-4010-a0d3-34030fde6f17 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:08.232494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cd995-0fa1-4604-8424-35a452b9318b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:08.245122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:08.246638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:08.247106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:08.247549 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:08.267190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:08.313495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:08.315466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1178/2402] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:08 2021] PUT /identity/v3/projects/77909e3d75c949528d10f49c5cadb4ee/users/756be33ce93f49a6bac60d6438a55b90/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:08.327628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a12b-44d3-4bb3-8c57-f21fac5404ed None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:08.328065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a12b-44d3-4bb3-8c57-f21fac5404ed None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:08.328516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a12b-44d3-4bb3-8c57-f21fac5404ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:08.345864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1225/2403] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:08 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:08.395555 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b4b0a12b-44d3-4bb3-8c57-f21fac5404ed None None] MFA Rules not processed for user `756be33ce93f49a6bac60d6438a55b90`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:08.399582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b4b0a12b-44d3-4bb3-8c57-f21fac5404ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:08.517881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1179/2404] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:08 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:08.629300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:08.633045 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:08.651113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177dc5-3fa7-4d10-b7ff-b3ec797e0193 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:08.713262 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47540-fc7d-441f-8ea2-4365b829e49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:08.714010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47540-fc7d-441f-8ea2-4365b829e49e service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:08.714291 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47540-fc7d-441f-8ea2-4365b829e49e service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:08.714631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a47540-fc7d-441f-8ea2-4365b829e49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:08.724628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a47540-fc7d-441f-8ea2-4365b829e49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:08.727292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a47540-fc7d-441f-8ea2-4365b829e49e service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:08.738298 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1226/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:08 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:09.836080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0a12b-44d3-4bb3-8c57-f21fac5404ed None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:09.863535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0a12b-44d3-4bb3-8c57-f21fac5404ed None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:09.873587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:09.874265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:09.874569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:09.874853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:09.881338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:09.977272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:09.979075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:10.009266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1180/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:09 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:12.412823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47540-fc7d-441f-8ea2-4365b829e49e service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:12.424581 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a47540-fc7d-441f-8ea2-4365b829e49e service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:12.431942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1bd1f-d803-427a-9d9b-7d212babb6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:12.432876 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1bd1f-d803-427a-9d9b-7d212babb6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:12.433150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1bd1f-d803-427a-9d9b-7d212babb6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:12.433483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1bd1f-d803-427a-9d9b-7d212babb6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:12.435584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e5b1bd1f-d803-427a-9d9b-7d212babb6f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:12.573987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1bd1f-d803-427a-9d9b-7d212babb6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:12.575733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1bd1f-d803-427a-9d9b-7d212babb6f4 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:12.601228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1227/2407] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:12 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:13.068448 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:13.116596 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843071ea-eaa5-4181-95ec-0888769cd6f9 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:13.119371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843071ea-eaa5-4181-95ec-0888769cd6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:13.119770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843071ea-eaa5-4181-95ec-0888769cd6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:13.189890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-843071ea-eaa5-4181-95ec-0888769cd6f9 None None] MFA Rules not processed for user `97c82e393b164313ad7a95eca6b65c26`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:13.192876 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-843071ea-eaa5-4181-95ec-0888769cd6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:13.247239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f3723-7d05-44d0-8267-c774fa34c85f service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:13.254610 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:13.255440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:13.255984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:13.256486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] PATH_INFO: `/v3/users/756be33ce93f49a6bac60d6438a55b90` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:13.268913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756be33ce93f49a6bac60d6438a55b90)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:13.270946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:13.344693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1228/2408] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:13 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:13.349651 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843071ea-eaa5-4181-95ec-0888769cd6f9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:13.351178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-843071ea-eaa5-4181-95ec-0888769cd6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:13.384021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843071ea-eaa5-4181-95ec-0888769cd6f9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:13.401775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:13.408160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:13.408160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:13.408160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:13.408160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:13.408160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:13.512408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756be33ce93f49a6bac60d6438a55b90'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:13.513165 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756be33ce93f49a6bac60d6438a55b90'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:13.513987 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756be33ce93f49a6bac60d6438a55b90'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:13.534500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1229/2409] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:13 2021] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:13.539687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:13.541678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:13.622721 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756be33ce93f49a6bac60d6438a55b90'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:13.641614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544510f2-5da6-4577-a803-6ffbe9240857 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:13.647804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4791e2ec-5e75-4003-a12a-2acc1bfaa2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756be33ce93f49a6bac60d6438a55b90'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:13.658611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18b8a1-3dbf-41ca-bcb3-567215689fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:13.659310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18b8a1-3dbf-41ca-bcb3-567215689fac admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:13.659586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18b8a1-3dbf-41ca-bcb3-567215689fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:13.659968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18b8a1-3dbf-41ca-bcb3-567215689fac admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:13.660611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18b8a1-3dbf-41ca-bcb3-567215689fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:13.662609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18b8a1-3dbf-41ca-bcb3-567215689fac admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:13.680517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1181/2410] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:13 2021] DELETE /identity/v3/users/756be33ce93f49a6bac60d6438a55b90 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:13.682406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b9d10-3897-48ed-8334-7c7a715edd3f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:13.683560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b9d10-3897-48ed-8334-7c7a715edd3f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:13.684080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b9d10-3897-48ed-8334-7c7a715edd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:13.725404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-932b9d10-3897-48ed-8334-7c7a715edd3f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:13.726797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-932b9d10-3897-48ed-8334-7c7a715edd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:13.819182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1230/2411] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:13 2021] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:13.824601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18b8a1-3dbf-41ca-bcb3-567215689fac admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:13.828913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1182/2412] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:13.839309 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b9d10-3897-48ed-8334-7c7a715edd3f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:13.840609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-932b9d10-3897-48ed-8334-7c7a715edd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:13.858814 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18b8a1-3dbf-41ca-bcb3-567215689fac admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:13.871584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96881444-4651-44ee-816c-3a00776a1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:13.872558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96881444-4651-44ee-816c-3a00776a1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:13.873030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96881444-4651-44ee-816c-3a00776a1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:13.873469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96881444-4651-44ee-816c-3a00776a1a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:13.874248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96881444-4651-44ee-816c-3a00776a1a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:13.875890 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96881444-4651-44ee-816c-3a00776a1a67 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:13.888272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1231/2413] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:13 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:13.895435 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96881444-4651-44ee-816c-3a00776a1a67 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:13.911864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96881444-4651-44ee-816c-3a00776a1a67 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:13.917245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d42f-54dd-42ff-8747-952bba25ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:13.918153 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d42f-54dd-42ff-8747-952bba25ac73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:13.918680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d42f-54dd-42ff-8747-952bba25ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:13.919206 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d42f-54dd-42ff-8747-952bba25ac73 admin admin] PATH_INFO: `/v3/projects/ab572ed9fb234e2eb59dd278b16bf840/users/147031f43265455081cb539cf5717147/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:13.938418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053d42f-54dd-42ff-8747-952bba25ac73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab572ed9fb234e2eb59dd278b16bf840, user_id=147031f43265455081cb539cf5717147, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:13.941743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053d42f-54dd-42ff-8747-952bba25ac73 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:13.948733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b9d10-3897-48ed-8334-7c7a715edd3f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:13.956785 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01122ea5-8628-4800-848b-7c264f911906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:13.957597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122ea5-8628-4800-848b-7c264f911906 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:13.957882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122ea5-8628-4800-848b-7c264f911906 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:13.958162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122ea5-8628-4800-848b-7c264f911906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:13.972133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01122ea5-8628-4800-848b-7c264f911906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:13.973969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01122ea5-8628-4800-848b-7c264f911906 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:13.991184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1183/2414] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:14.050087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1232/2415] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:13 2021] PUT /identity/v3/projects/ab572ed9fb234e2eb59dd278b16bf840/users/147031f43265455081cb539cf5717147/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:14.051480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01122ea5-8628-4800-848b-7c264f911906 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:14.063275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01122ea5-8628-4800-848b-7c264f911906 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:14.129005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:14.129680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:14.130012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:14.130233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:14.131150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:14.132661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:14.143894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1184/2416] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:14.152486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d42f-54dd-42ff-8747-952bba25ac73 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:14.165041 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d42f-54dd-42ff-8747-952bba25ac73 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:14.169908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:14.170940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:14.171208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:14.171485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] PATH_INFO: `/v3/projects/ab572ed9fb234e2eb59dd278b16bf840/users/147031f43265455081cb539cf5717147/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:14.173644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab572ed9fb234e2eb59dd278b16bf840, user_id=147031f43265455081cb539cf5717147, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:14.176504 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:14.190925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1233/2417] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:14 2021] PUT /identity/v3/projects/ab572ed9fb234e2eb59dd278b16bf840/users/147031f43265455081cb539cf5717147/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:14.567086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:14.569143 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:14.600044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444233d-91ac-46a6-8520-abd939ba962d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:14.646981 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:14.648669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:14.697842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:14.702791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:14.702791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:14.702791 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] PATH_INFO: `/v3/users/f3bcc14f317d4265841dc50b8eec5a49` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:14.706298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bcc14f317d4265841dc50b8eec5a49)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:14.711815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:14.778455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1315a-21a3-45d2-bc35-c7512d1c0f9a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:14.786464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:14.787586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:14.787926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:14.788259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] PATH_INFO: `/v3/projects/77909e3d75c949528d10f49c5cadb4ee` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:14.790082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=77909e3d75c949528d10f49c5cadb4ee)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:14.792437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:14.934996 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bcc14f317d4265841dc50b8eec5a49'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:14.936193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bcc14f317d4265841dc50b8eec5a49'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:14.936730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77909e3d75c949528d10f49c5cadb4ee', 'request_id': 'req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:14.936880 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bcc14f317d4265841dc50b8eec5a49'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.036307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77909e3d75c949528d10f49c5cadb4ee', 'request_id': 'req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.044725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77909e3d75c949528d10f49c5cadb4ee', 'request_id': 'req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.058841 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] The token cache is being invalidate because project 77909e3d75c949528d10f49c5cadb4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:15.059166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.059794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.065456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1234/2418] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:14 2021] DELETE /identity/v3/projects/77909e3d75c949528d10f49c5cadb4ee => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:15.065456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:15.065456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:15.119965 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bcc14f317d4265841dc50b8eec5a49'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.133437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3859b4c4-0354-416d-a025-e020805079b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bcc14f317d4265841dc50b8eec5a49'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.165317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1185/2419] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:14 2021] DELETE /identity/v3/users/f3bcc14f317d4265841dc50b8eec5a49 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:15.177682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244fdc5-2d99-4669-ae24-68dfc023ed95 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:15.178211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244fdc5-2d99-4669-ae24-68dfc023ed95 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:15.178658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244fdc5-2d99-4669-ae24-68dfc023ed95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:15.188318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d219d-9f2c-4bd7-82b5-5d6120fea9ae admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:15.208668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d244fdc5-2d99-4669-ae24-68dfc023ed95 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:15.212479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d244fdc5-2d99-4669-ae24-68dfc023ed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:15.292222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1186/2420] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:15.293817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259b913-f2dc-4f2a-90c1-58ef57170d50 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:15.296368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259b913-f2dc-4f2a-90c1-58ef57170d50 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:15.296879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259b913-f2dc-4f2a-90c1-58ef57170d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:15.320091 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:15.322304 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:15.322304 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:15.322533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] PATH_INFO: `/v3/users/46ff990ca6534fe1bf56235b2e8f8514` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:15.323932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ff990ca6534fe1bf56235b2e8f8514)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:15.326594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:15.336242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d259b913-f2dc-4f2a-90c1-58ef57170d50 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:15.338613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d259b913-f2dc-4f2a-90c1-58ef57170d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:15.361870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1187/2421] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:15.361870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3900ff-ce1c-4e30-8432-57cafd294703 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:15.361870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3900ff-ce1c-4e30-8432-57cafd294703 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:15.361870 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3900ff-ce1c-4e30-8432-57cafd294703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:15.402775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6f3900ff-ce1c-4e30-8432-57cafd294703 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:15.404030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6f3900ff-ce1c-4e30-8432-57cafd294703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:15.418703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1188/2422] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:15.418703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3900ff-ce1c-4e30-8432-57cafd294703 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:15.420429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6f3900ff-ce1c-4e30-8432-57cafd294703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:15.483806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3900ff-ce1c-4e30-8432-57cafd294703 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:15.488000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36b88a-369f-4621-ae90-fee54cd89f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:15.488646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36b88a-369f-4621-ae90-fee54cd89f68 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:15.488930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36b88a-369f-4621-ae90-fee54cd89f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:15.489205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36b88a-369f-4621-ae90-fee54cd89f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:15.503660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36b88a-369f-4621-ae90-fee54cd89f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:15.505833 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36b88a-369f-4621-ae90-fee54cd89f68 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:15.517171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1189/2423] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:15.518596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36b88a-369f-4621-ae90-fee54cd89f68 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:15.528674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36b88a-369f-4621-ae90-fee54cd89f68 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:15.535038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:15.535853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:15.536104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:15.536375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:15.546065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:15.546065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:15.546065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:15.552520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1190/2424] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:16:15.559013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:15.571097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b58e1-dc55-40cf-bde1-f06ca62c44f1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:15.577691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:15.578511 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:15.578925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:15.579293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:15.580247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:15.585147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:15.635212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ff990ca6534fe1bf56235b2e8f8514'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.635889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ff990ca6534fe1bf56235b2e8f8514'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.637315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ff990ca6534fe1bf56235b2e8f8514'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.727733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ff990ca6534fe1bf56235b2e8f8514'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.747197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1191/2425] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:15 2021] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:15.749530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:15.752868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:15.765151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-886218b4-16bb-4799-9aaf-e6ded28e7a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ff990ca6534fe1bf56235b2e8f8514'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:15.788236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1235/2426] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:15 2021] DELETE /identity/v3/users/46ff990ca6534fe1bf56235b2e8f8514 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:15.794427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ce5d-ed8b-4ad1-ae84-149c0ac38f14 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:15.795142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ce5d-ed8b-4ad1-ae84-149c0ac38f14 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:15.795946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ce5d-ed8b-4ad1-ae84-149c0ac38f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:15.817861 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3906ce5d-ed8b-4ad1-ae84-149c0ac38f14 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:15.819214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3906ce5d-ed8b-4ad1-ae84-149c0ac38f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:15.891029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ffd50-a0f6-49a9-91f7-f60a18083ece admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:15.950972 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1236/2427] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:15.963453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ce5d-ed8b-4ad1-ae84-149c0ac38f14 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:15.966338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3906ce5d-ed8b-4ad1-ae84-149c0ac38f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:16.054651 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1960e68-2386-45bc-95c1-1b71dc53dbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:16.055582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1960e68-2386-45bc-95c1-1b71dc53dbdb admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:16.056314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1960e68-2386-45bc-95c1-1b71dc53dbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:16.056787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1960e68-2386-45bc-95c1-1b71dc53dbdb admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:16.058746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1960e68-2386-45bc-95c1-1b71dc53dbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:16.061905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1960e68-2386-45bc-95c1-1b71dc53dbdb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:16.064336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ce5d-ed8b-4ad1-ae84-149c0ac38f14 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:16.069958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:16.069958 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:16.070467 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:16.070647 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:16.086993 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:16.090920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:16.118344 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1237/2428] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:16.124590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:16.127663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:16.152912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2264f9e-3245-4287-a084-7ec63229850e service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:16.164382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:16.167216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:16.168690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:16.169212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] PATH_INFO: `/v3/projects/d8ec8bfd803c414caab8708ca2c099c8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:16.172309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ec8bfd803c414caab8708ca2c099c8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:16.176441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:16.213400 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1192/2429] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:15 2021] POST /identity/v3/users => generated 292 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:16.215078 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1960e68-2386-45bc-95c1-1b71dc53dbdb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:16.230781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1960e68-2386-45bc-95c1-1b71dc53dbdb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:16.240518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40da4-a18a-451e-ba1e-9e2a43c300ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:16.241282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40da4-a18a-451e-ba1e-9e2a43c300ea admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:16.241566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40da4-a18a-451e-ba1e-9e2a43c300ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:16.241847 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40da4-a18a-451e-ba1e-9e2a43c300ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:16.242639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b40da4-a18a-451e-ba1e-9e2a43c300ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:16.244595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b40da4-a18a-451e-ba1e-9e2a43c300ea admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:16.262133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1193/2430] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:16 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:16.270231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40da4-a18a-451e-ba1e-9e2a43c300ea admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:16.284188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40da4-a18a-451e-ba1e-9e2a43c300ea admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:16.291102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f28b8-e4e9-4fa6-b2e4-49fb21d46104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:16.292129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f28b8-e4e9-4fa6-b2e4-49fb21d46104 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:16.292414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f28b8-e4e9-4fa6-b2e4-49fb21d46104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:16.292768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f28b8-e4e9-4fa6-b2e4-49fb21d46104 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:16.294769 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f28b8-e4e9-4fa6-b2e4-49fb21d46104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:16.297271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f28b8-e4e9-4fa6-b2e4-49fb21d46104 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:16.314404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1194/2431] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:16 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:16.317681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f28b8-e4e9-4fa6-b2e4-49fb21d46104 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:16.340392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f28b8-e4e9-4fa6-b2e4-49fb21d46104 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:16.371878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb40ed5-745a-41b1-beff-dfa0da993f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:16.372790 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40ed5-745a-41b1-beff-dfa0da993f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:16.373065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40ed5-745a-41b1-beff-dfa0da993f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:16.374763 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40ed5-745a-41b1-beff-dfa0da993f63 admin admin] PATH_INFO: `/v3/projects/1b90b3d6739f4eef8dc3f2a78bb8a043/users/16dc67eb7c164a2fb9ce650c032e1340/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:16.387502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ec8bfd803c414caab8708ca2c099c8', 'request_id': 'req-19cf64e5-916b-4528-8eeb-60f1e5024500'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:16.405466 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40ed5-745a-41b1-beff-dfa0da993f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b90b3d6739f4eef8dc3f2a78bb8a043, user_id=16dc67eb7c164a2fb9ce650c032e1340, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:16.408221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40ed5-745a-41b1-beff-dfa0da993f63 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:16.498316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ec8bfd803c414caab8708ca2c099c8', 'request_id': 'req-19cf64e5-916b-4528-8eeb-60f1e5024500'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:16.516193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ec8bfd803c414caab8708ca2c099c8', 'request_id': 'req-19cf64e5-916b-4528-8eeb-60f1e5024500'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:16.534721 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] The token cache is being invalidate because project d8ec8bfd803c414caab8708ca2c099c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:16.538002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:16.538257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1195/2432] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:16 2021] PUT /identity/v3/projects/1b90b3d6739f4eef8dc3f2a78bb8a043/users/16dc67eb7c164a2fb9ce650c032e1340/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:16.538345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:16.541299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880536-3220-4948-8a6f-623121a669e9 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:16.541895 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880536-3220-4948-8a6f-623121a669e9 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:16.542341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880536-3220-4948-8a6f-623121a669e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:16.546160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1238/2433] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:16 2021] DELETE /identity/v3/projects/d8ec8bfd803c414caab8708ca2c099c8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:16.549900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:16.554472 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:16.593195 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-8d880536-3220-4948-8a6f-623121a669e9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:16.599452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8d880536-3220-4948-8a6f-623121a669e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:16.783575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1196/2434] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:16.786222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf64e5-916b-4528-8eeb-60f1e5024500 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:16.817236 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:16.818131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:16.818414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:16.818738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] PATH_INFO: `/v3/users/a4dce7a393a84d1ca3fa334dc89c9369` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:16.820148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dce7a393a84d1ca3fa334dc89c9369)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:16.822120 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:16.853637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d880536-3220-4948-8a6f-623121a669e9 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:16.856251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8d880536-3220-4948-8a6f-623121a669e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:17.008173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d880536-3220-4948-8a6f-623121a669e9 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:17.032331 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:17.032963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dce7a393a84d1ca3fa334dc89c9369'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.033891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dce7a393a84d1ca3fa334dc89c9369'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.034059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:17.034464 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:17.034650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dce7a393a84d1ca3fa334dc89c9369'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.035541 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:17.039680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:17.106817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:17.110312 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:17.119853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dce7a393a84d1ca3fa334dc89c9369'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.124191 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1197/2435] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:17.138801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:17.138801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:17.140523 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4e156632-9efa-441d-99dd-17cce90354e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dce7a393a84d1ca3fa334dc89c9369'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.160043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa15f-f1b8-4730-b378-a8e80fb04f9e service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:17.165535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1239/2436] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:16 2021] DELETE /identity/v3/users/a4dce7a393a84d1ca3fa334dc89c9369 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:17.172635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:17.173786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:17.174328 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:17.174536 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] PATH_INFO: `/v3/projects/aa13744396cb4626a4974a73d0afcd2e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:17.176215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa13744396cb4626a4974a73d0afcd2e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:17.179387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:17.327310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa13744396cb4626a4974a73d0afcd2e', 'request_id': 'req-30d9b852-de94-4633-8af0-984988e54b8b'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.445033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa13744396cb4626a4974a73d0afcd2e', 'request_id': 'req-30d9b852-de94-4633-8af0-984988e54b8b'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.453417 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa13744396cb4626a4974a73d0afcd2e', 'request_id': 'req-30d9b852-de94-4633-8af0-984988e54b8b'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.470433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] The token cache is being invalidate because project aa13744396cb4626a4974a73d0afcd2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:17.470912 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.471643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-30d9b852-de94-4633-8af0-984988e54b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:17.503213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1198/2437] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:17 2021] DELETE /identity/v3/projects/aa13744396cb4626a4974a73d0afcd2e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:17.513517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dff15-a5d1-4f9c-91bf-5e08862edb54 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:17.514200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dff15-a5d1-4f9c-91bf-5e08862edb54 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:17.518466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dff15-a5d1-4f9c-91bf-5e08862edb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:17.571917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b98dff15-a5d1-4f9c-91bf-5e08862edb54 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:17.612313 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b98dff15-a5d1-4f9c-91bf-5e08862edb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:17.726650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1240/2438] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:17.729274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b437a-4cf1-4b33-8c9e-b6fc4115645a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:17.730822 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b437a-4cf1-4b33-8c9e-b6fc4115645a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:17.731344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b437a-4cf1-4b33-8c9e-b6fc4115645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:17.758959 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-554b437a-4cf1-4b33-8c9e-b6fc4115645a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:17.762104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-554b437a-4cf1-4b33-8c9e-b6fc4115645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:17.781563 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1199/2439] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:17.785979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dff15-a5d1-4f9c-91bf-5e08862edb54 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:17.796876 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dff15-a5d1-4f9c-91bf-5e08862edb54 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:17.802877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:17.803707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:17.803992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:17.804269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:17.805694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:17.807893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:17.810400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:17.829160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1241/2440] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:16:17.834760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b437a-4cf1-4b33-8c9e-b6fc4115645a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:17.874259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b437a-4cf1-4b33-8c9e-b6fc4115645a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:17.895178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:17.905697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:17.925236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:17.939606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:17.939606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:17.939606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:17.939606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:17.939606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:17.951039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1c5e2-77bc-4e47-b7f4-3a323a200746 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:17.960834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:17.962001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:17.963057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:17.963499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] PATH_INFO: `/v3/projects/8136af3ba28e4b46b2b135f3027bc0ca` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:17.965087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8136af3ba28e4b46b2b135f3027bc0ca)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:17.967684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:18.116689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1200/2441] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:17 2021] POST /identity/v3/projects => generated 391 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:18.117683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:18.124086 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:18.141180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8136af3ba28e4b46b2b135f3027bc0ca', 'request_id': 'req-5f835626-0e53-44ab-9846-08109b024925'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.226069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8136af3ba28e4b46b2b135f3027bc0ca', 'request_id': 'req-5f835626-0e53-44ab-9846-08109b024925'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.232159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8136af3ba28e4b46b2b135f3027bc0ca', 'request_id': 'req-5f835626-0e53-44ab-9846-08109b024925'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.247257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7a47d-55f4-4952-bdc3-5cf516951154 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:18.263160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] The token cache is being invalidate because project 8136af3ba28e4b46b2b135f3027bc0ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:18.263442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.264163 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.267726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1242/2442] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:17 2021] DELETE /identity/v3/projects/8136af3ba28e4b46b2b135f3027bc0ca => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:18.269003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:18.270401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:18.389322 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:18.390223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:18.390509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:18.390860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] PATH_INFO: `/v3/users/7286b79430fb4bfd9000f2551f9f228e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:18.393039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7286b79430fb4bfd9000f2551f9f228e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:18.394712 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:18.428970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f835626-0e53-44ab-9846-08109b024925 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:18.448058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f629e8e-e7a3-4276-a868-749f0f829d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:18.448058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629e8e-e7a3-4276-a868-749f0f829d21 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:18.448058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629e8e-e7a3-4276-a868-749f0f829d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:18.448058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629e8e-e7a3-4276-a868-749f0f829d21 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:18.448455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f629e8e-e7a3-4276-a868-749f0f829d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:18.448455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f629e8e-e7a3-4276-a868-749f0f829d21 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:18.584901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1243/2443] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:18 2021] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:18.592181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d17f1-5c41-43cb-9631-b87698a19d43 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:18.592545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d17f1-5c41-43cb-9631-b87698a19d43 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:18.592891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d17f1-5c41-43cb-9631-b87698a19d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:18.620079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-842d17f1-5c41-43cb-9631-b87698a19d43 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:18.621411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-842d17f1-5c41-43cb-9631-b87698a19d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:18.634076 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1244/2444] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:18.635198 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d17f1-5c41-43cb-9631-b87698a19d43 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:18.653552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d17f1-5c41-43cb-9631-b87698a19d43 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:18.662779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a426c1-8d7a-465e-9af9-bf106751cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:18.663559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a426c1-8d7a-465e-9af9-bf106751cc5c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:18.663907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a426c1-8d7a-465e-9af9-bf106751cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:18.664251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a426c1-8d7a-465e-9af9-bf106751cc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:18.666060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a426c1-8d7a-465e-9af9-bf106751cc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:18.668903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a426c1-8d7a-465e-9af9-bf106751cc5c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:18.689807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1245/2445] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:18 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:18.691380 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f9c0e-f6d7-4f22-bfb6-1316188cc7a2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:18.691784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f9c0e-f6d7-4f22-bfb6-1316188cc7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:18.692165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f9c0e-f6d7-4f22-bfb6-1316188cc7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:18.722868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e01f9c0e-f6d7-4f22-bfb6-1316188cc7a2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:18.724142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e01f9c0e-f6d7-4f22-bfb6-1316188cc7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:18.729129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7286b79430fb4bfd9000f2551f9f228e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.730036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7286b79430fb4bfd9000f2551f9f228e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.734100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7286b79430fb4bfd9000f2551f9f228e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.754264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1246/2446] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:18.758378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f9c0e-f6d7-4f22-bfb6-1316188cc7a2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:18.759459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e01f9c0e-f6d7-4f22-bfb6-1316188cc7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:18.776636 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f9c0e-f6d7-4f22-bfb6-1316188cc7a2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:18.785324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df10fb-db33-4c75-8361-d80d25703169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:18.789547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df10fb-db33-4c75-8361-d80d25703169 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:18.799132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df10fb-db33-4c75-8361-d80d25703169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:18.799132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df10fb-db33-4c75-8361-d80d25703169 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:18.799132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df10fb-db33-4c75-8361-d80d25703169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:18.799132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df10fb-db33-4c75-8361-d80d25703169 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:18.815663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1247/2447] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:18 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:18.816845 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df10fb-db33-4c75-8361-d80d25703169 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:18.843431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df10fb-db33-4c75-8361-d80d25703169 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:18.845787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7286b79430fb4bfd9000f2551f9f228e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.881172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7286b79430fb4bfd9000f2551f9f228e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:18.895137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838f81c-6d5b-4db7-a95a-480879bcf2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:18.895821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838f81c-6d5b-4db7-a95a-480879bcf2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:18.927869 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838f81c-6d5b-4db7-a95a-480879bcf2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:18.928196 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838f81c-6d5b-4db7-a95a-480879bcf2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:18.930267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838f81c-6d5b-4db7-a95a-480879bcf2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:18.930924 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838f81c-6d5b-4db7-a95a-480879bcf2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:18.937076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1201/2448] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:18 2021] DELETE /identity/v3/users/7286b79430fb4bfd9000f2551f9f228e => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:18.937076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:18.939189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838f81c-6d5b-4db7-a95a-480879bcf2e2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:18.985037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1248/2449] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:16:18.986390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ad97-eaeb-4ce3-ba5b-5c9ad9b30e19 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:18.988767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ad97-eaeb-4ce3-ba5b-5c9ad9b30e19 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:18.989258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66ad97-eaeb-4ce3-ba5b-5c9ad9b30e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:19.027862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-6b66ad97-eaeb-4ce3-ba5b-5c9ad9b30e19 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:19.031733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6b66ad97-eaeb-4ce3-ba5b-5c9ad9b30e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:19.187066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a1eb7-2427-42b1-a4c9-47d248031835 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:19.220652 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:19.221782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:19.227983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:19.229163 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] PATH_INFO: `/v3/projects/9de64ce3e5334c68862683fdd1a48867/users/12a89e3ae4d84926861145d1ba8eded2/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:19.271375 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1249/2450] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:19.272409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ad97-eaeb-4ce3-ba5b-5c9ad9b30e19 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:19.284667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de64ce3e5334c68862683fdd1a48867, user_id=12a89e3ae4d84926861145d1ba8eded2, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:19.288335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66ad97-eaeb-4ce3-ba5b-5c9ad9b30e19 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:19.297166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:19.303595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f02835-6a27-4bec-b811-fc5e03896f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:19.303595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02835-6a27-4bec-b811-fc5e03896f68 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:19.303595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02835-6a27-4bec-b811-fc5e03896f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:19.303595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02835-6a27-4bec-b811-fc5e03896f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:19.304061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02835-6a27-4bec-b811-fc5e03896f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:19.323458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02835-6a27-4bec-b811-fc5e03896f68 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:19.399268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1202/2451] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:18 2021] PUT /identity/v3/projects/9de64ce3e5334c68862683fdd1a48867/users/12a89e3ae4d84926861145d1ba8eded2/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:19.400571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:19.409828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:19.452415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1250/2452] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:19 2021] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:19.454157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abfebe-06ca-4f8a-9358-6fd4b191986f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:19.456493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abfebe-06ca-4f8a-9358-6fd4b191986f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:19.456493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abfebe-06ca-4f8a-9358-6fd4b191986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:19.543768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-58abfebe-06ca-4f8a-9358-6fd4b191986f None None] MFA Rules not processed for user `12a89e3ae4d84926861145d1ba8eded2`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:19.544558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-58abfebe-06ca-4f8a-9358-6fd4b191986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:19.632586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a943a33-3641-4265-8804-b7f58b7d1dba admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:19.672401 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1251/2453] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:19 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:19.673622 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abfebe-06ca-4f8a-9358-6fd4b191986f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:19.786097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abfebe-06ca-4f8a-9358-6fd4b191986f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:19.792967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b70a56-7db6-4e2d-833f-3bb6f8cadc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:19.794039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70a56-7db6-4e2d-833f-3bb6f8cadc32 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:19.794320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70a56-7db6-4e2d-833f-3bb6f8cadc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:19.795442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70a56-7db6-4e2d-833f-3bb6f8cadc32 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:19.796700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b70a56-7db6-4e2d-833f-3bb6f8cadc32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:19.798743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b70a56-7db6-4e2d-833f-3bb6f8cadc32 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:19.817811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:19.823625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:19.823625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:19.823625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:19.840813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:19.842628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:19.854811 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1203/2454] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:19.856330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:19.859113 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:19.926926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1252/2455] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:19 2021] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:19.931349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b70a56-7db6-4e2d-833f-3bb6f8cadc32 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:19.973355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b70a56-7db6-4e2d-833f-3bb6f8cadc32 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:19.986855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17072-8b8f-42c9-906b-d0000ad6903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:19.987551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17072-8b8f-42c9-906b-d0000ad6903a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:19.987832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17072-8b8f-42c9-906b-d0000ad6903a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:19.988151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17072-8b8f-42c9-906b-d0000ad6903a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:19.988842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17072-8b8f-42c9-906b-d0000ad6903a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:19.991838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17072-8b8f-42c9-906b-d0000ad6903a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:20.001081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9551a17-a2f1-4fea-b213-edf0da16e6c2 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:20.014047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abfaf-58b4-4135-874b-39ada36ddc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:20.014742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abfaf-58b4-4135-874b-39ada36ddc19 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:20.015296 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abfaf-58b4-4135-874b-39ada36ddc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:20.015588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abfaf-58b4-4135-874b-39ada36ddc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:20.021543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1253/2456] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:19 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:20.024093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93d0d8-d026-4059-86da-e0f3574c21cb None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:20.025061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93d0d8-d026-4059-86da-e0f3574c21cb None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:20.028279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93d0d8-d026-4059-86da-e0f3574c21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:20.043566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986abfaf-58b4-4135-874b-39ada36ddc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:20.045074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986abfaf-58b4-4135-874b-39ada36ddc19 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:20.073264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1204/2457] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:19 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:20.074700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abfaf-58b4-4135-874b-39ada36ddc19 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:20.095656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abfaf-58b4-4135-874b-39ada36ddc19 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:20.101483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-3e93d0d8-d026-4059-86da-e0f3574c21cb None None] MFA Rules not processed for user `16dc67eb7c164a2fb9ce650c032e1340`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:20.103413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95ba4-0633-460f-8f64-0f4aaf3b8d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:20.103914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95ba4-0633-460f-8f64-0f4aaf3b8d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:20.104336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95ba4-0633-460f-8f64-0f4aaf3b8d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:20.104618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc95ba4-0633-460f-8f64-0f4aaf3b8d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:20.105407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc95ba4-0633-460f-8f64-0f4aaf3b8d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:20.107070 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc95ba4-0633-460f-8f64-0f4aaf3b8d3b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:20.109829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3e93d0d8-d026-4059-86da-e0f3574c21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:20.137823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1205/2458] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:20.142250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95ba4-0633-460f-8f64-0f4aaf3b8d3b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:20.164013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc95ba4-0633-460f-8f64-0f4aaf3b8d3b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:20.178702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d01b26-7ddb-40a0-ad82-c0c1da0e4698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:20.179863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01b26-7ddb-40a0-ad82-c0c1da0e4698 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:20.180147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01b26-7ddb-40a0-ad82-c0c1da0e4698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:20.180423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d01b26-7ddb-40a0-ad82-c0c1da0e4698 admin admin] PATH_INFO: `/v3/projects/df71ee1e35a44f0191dcd04c01e72c08/users/57e3d00871684c91a6ec9fe83a6331c9/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:20.228903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d01b26-7ddb-40a0-ad82-c0c1da0e4698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df71ee1e35a44f0191dcd04c01e72c08, user_id=57e3d00871684c91a6ec9fe83a6331c9, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:20.236373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d01b26-7ddb-40a0-ad82-c0c1da0e4698 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:20.288071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1254/2459] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:20.318119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93d0d8-d026-4059-86da-e0f3574c21cb None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:20.324383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3e93d0d8-d026-4059-86da-e0f3574c21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:20.337382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1206/2460] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:20 2021] PUT /identity/v3/projects/df71ee1e35a44f0191dcd04c01e72c08/users/57e3d00871684c91a6ec9fe83a6331c9/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:20.339454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15ba7-edb5-4109-a6ca-848b4f2705de None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:20.340108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15ba7-edb5-4109-a6ca-848b4f2705de None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:20.340594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f15ba7-edb5-4109-a6ca-848b4f2705de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:20.353929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93d0d8-d026-4059-86da-e0f3574c21cb None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:20.375274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-86f15ba7-edb5-4109-a6ca-848b4f2705de None None] MFA Rules not processed for user `57e3d00871684c91a6ec9fe83a6331c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:20.378097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-86f15ba7-edb5-4109-a6ca-848b4f2705de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:20.463492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a142a1-8b4e-4156-9bb7-7cbeab772b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:20.465968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a142a1-8b4e-4156-9bb7-7cbeab772b9c service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:20.465968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a142a1-8b4e-4156-9bb7-7cbeab772b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:20.465968 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a142a1-8b4e-4156-9bb7-7cbeab772b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:20.515628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1207/2461] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:20 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:20.520161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15ba7-edb5-4109-a6ca-848b4f2705de None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:20.616643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f15ba7-edb5-4109-a6ca-848b4f2705de None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:20.623786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:20.624695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:20.625077 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:20.625357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:20.626169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:20.628913 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:20.642998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a142a1-8b4e-4156-9bb7-7cbeab772b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:20.649456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a142a1-8b4e-4156-9bb7-7cbeab772b9c service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:20.663881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1255/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:20 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:16:20.749461 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1208/2463] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:20 2021] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:20.750712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a142a1-8b4e-4156-9bb7-7cbeab772b9c service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:20.790819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a142a1-8b4e-4156-9bb7-7cbeab772b9c service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:20.842964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:20.845007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:20.985308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0fe20-b22b-4556-b6ac-dd5713dc92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:20.986664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0fe20-b22b-4556-b6ac-dd5713dc92fb admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:20.987273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0fe20-b22b-4556-b6ac-dd5713dc92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:20.987763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0fe20-b22b-4556-b6ac-dd5713dc92fb admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:20.989383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0fe20-b22b-4556-b6ac-dd5713dc92fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:20.991859 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0fe20-b22b-4556-b6ac-dd5713dc92fb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:21.104136 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1256/2464] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:20 2021] POST /identity/v3/users => generated 288 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:21.108740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0fe20-b22b-4556-b6ac-dd5713dc92fb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:21.190083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46118dbb-6c65-4906-9b0e-2a015bc40195 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:21.205545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0fe20-b22b-4556-b6ac-dd5713dc92fb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:21.245548 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd21ad-5f9f-4db0-bc2e-1ab9aea27a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:21.247776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:21.248663 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:21.248945 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:21.255172 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] PATH_INFO: `/v3/projects/6c607062535548eba245a09731a59175` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:21.255321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd21ad-5f9f-4db0-bc2e-1ab9aea27a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:21.255321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd21ad-5f9f-4db0-bc2e-1ab9aea27a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:21.255321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd21ad-5f9f-4db0-bc2e-1ab9aea27a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:21.255321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd21ad-5f9f-4db0-bc2e-1ab9aea27a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:21.255321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd21ad-5f9f-4db0-bc2e-1ab9aea27a84 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:21.255655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c607062535548eba245a09731a59175)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:21.257477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:21.304578 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1257/2465] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:21.305553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd21ad-5f9f-4db0-bc2e-1ab9aea27a84 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:21.341527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd21ad-5f9f-4db0-bc2e-1ab9aea27a84 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:21.364828 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41926d07-f4fc-4230-ac3e-fe58ec9f88de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:21.365530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41926d07-f4fc-4230-ac3e-fe58ec9f88de admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:21.365813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41926d07-f4fc-4230-ac3e-fe58ec9f88de admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:21.366102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41926d07-f4fc-4230-ac3e-fe58ec9f88de admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:21.367047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41926d07-f4fc-4230-ac3e-fe58ec9f88de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:21.372152 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41926d07-f4fc-4230-ac3e-fe58ec9f88de admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:21.389907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1258/2466] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:21.392822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41926d07-f4fc-4230-ac3e-fe58ec9f88de admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:21.419977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41926d07-f4fc-4230-ac3e-fe58ec9f88de admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:21.451208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:21.452124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:21.452406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:21.452681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] PATH_INFO: `/v3/projects/1f4858f0e9344557922fc70f7157d0d6/users/8c18fff6e5074d959df6cdf4f13580bf/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:21.486640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c607062535548eba245a09731a59175', 'request_id': 'req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:21.547610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4858f0e9344557922fc70f7157d0d6, user_id=8c18fff6e5074d959df6cdf4f13580bf, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:21.550376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:21.561289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c607062535548eba245a09731a59175', 'request_id': 'req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:21.570353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c607062535548eba245a09731a59175', 'request_id': 'req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:21.586944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] The token cache is being invalidate because project 6c607062535548eba245a09731a59175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:21.587566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:21.588609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-cd902cf0-b1bb-4fb5-8a30-dc2f6c736960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:21.595491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1209/2467] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:20 2021] DELETE /identity/v3/projects/6c607062535548eba245a09731a59175 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:21.596856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0d15-b2de-4da7-a2a7-d772cc10e947 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:21.597766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0d15-b2de-4da7-a2a7-d772cc10e947 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:21.597766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0d15-b2de-4da7-a2a7-d772cc10e947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:21.619656 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-dc0d0d15-b2de-4da7-a2a7-d772cc10e947 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:21.621678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-dc0d0d15-b2de-4da7-a2a7-d772cc10e947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:21.684327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1259/2468] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:21 2021] PUT /identity/v3/projects/1f4858f0e9344557922fc70f7157d0d6/users/8c18fff6e5074d959df6cdf4f13580bf/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:21.684481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:21.694918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:21.807402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc0790-f0b4-4359-a0bb-e86dbe956799 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:21.813675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:21.814877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:21.815306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:21.815723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] PATH_INFO: `/v3/users/df5e59d2d1544783a895535ae4024fbb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:21.817331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5e59d2d1544783a895535ae4024fbb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:21.819907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:21.826806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1210/2469] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:16:21 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:21.828206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae915fb-75bf-44f8-b188-1d41f05b4849 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:21.828496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae915fb-75bf-44f8-b188-1d41f05b4849 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:21.828774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae915fb-75bf-44f8-b188-1d41f05b4849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:21.926471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5ae915fb-75bf-44f8-b188-1d41f05b4849 None None] MFA Rules not processed for user `8c18fff6e5074d959df6cdf4f13580bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:21.927935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5ae915fb-75bf-44f8-b188-1d41f05b4849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:22.024905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1211/2470] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:22.024905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae915fb-75bf-44f8-b188-1d41f05b4849 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:22.024905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5ae915fb-75bf-44f8-b188-1d41f05b4849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:22.127169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5e59d2d1544783a895535ae4024fbb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:22.128007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5e59d2d1544783a895535ae4024fbb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:22.128862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5e59d2d1544783a895535ae4024fbb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:22.135571 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae915fb-75bf-44f8-b188-1d41f05b4849 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:22.140804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:22.141430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:22.141710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:22.141983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:22.144103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:22.193937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5e59d2d1544783a895535ae4024fbb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:22.234096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5e59d2d1544783a895535ae4024fbb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:22.262173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:22.263787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:22.278628 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1212/2471] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:16:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:16:22.279447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1260/2472] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:21 2021] DELETE /identity/v3/users/df5e59d2d1544783a895535ae4024fbb => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:22.280680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:22.284800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:22.304602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e148d-f9b6-46f8-92b7-1ad6a21d770b service swift] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:22.373280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004c6c8-a195-4359-b191-c4bac775e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:22.374065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004c6c8-a195-4359-b191-c4bac775e5de admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:22.374462 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004c6c8-a195-4359-b191-c4bac775e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:22.375109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004c6c8-a195-4359-b191-c4bac775e5de admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:22.375731 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004c6c8-a195-4359-b191-c4bac775e5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:22.377768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004c6c8-a195-4359-b191-c4bac775e5de admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:22.528505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1213/2473] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:22 2021] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:22.532585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:22.545285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7c79c-ee25-433f-9653-d145730e83dd admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:22.648911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195bcc-a547-48aa-8863-49388e08bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:22.649985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195bcc-a547-48aa-8863-49388e08bf0a admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:22.649985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195bcc-a547-48aa-8863-49388e08bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:22.650158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84195bcc-a547-48aa-8863-49388e08bf0a admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:22.650858 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84195bcc-a547-48aa-8863-49388e08bf0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:22.652998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84195bcc-a547-48aa-8863-49388e08bf0a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:22.810058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004c6c8-a195-4359-b191-c4bac775e5de admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:22.815425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1261/2474] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:22 2021] POST /identity/v3/users => generated 296 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:22.828853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004c6c8-a195-4359-b191-c4bac775e5de admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:22.844193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c127-b0a4-4e61-96ef-63c605d42da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:22.844885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c127-b0a4-4e61-96ef-63c605d42da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:22.846830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c127-b0a4-4e61-96ef-63c605d42da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:22.846830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c127-b0a4-4e61-96ef-63c605d42da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:22.846830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c127-b0a4-4e61-96ef-63c605d42da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:22.847799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c127-b0a4-4e61-96ef-63c605d42da4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:22.894032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1214/2475] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:22 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:22.895597 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195bcc-a547-48aa-8863-49388e08bf0a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:22.912234 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84195bcc-a547-48aa-8863-49388e08bf0a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:22.918908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa854-b032-4087-9e5f-c7017a7c65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:22.921970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa854-b032-4087-9e5f-c7017a7c65b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:22.922438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa854-b032-4087-9e5f-c7017a7c65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:22.922881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa854-b032-4087-9e5f-c7017a7c65b2 admin admin] PATH_INFO: `/v3/projects/9b120e4df5c742d5b4623340825aa939/users/d32722b97d954803bcada8be18293332/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:22.966643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa854-b032-4087-9e5f-c7017a7c65b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b120e4df5c742d5b4623340825aa939, user_id=d32722b97d954803bcada8be18293332, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:22.969575 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa854-b032-4087-9e5f-c7017a7c65b2 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:22.987690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13a58-efb0-48aa-894e-f3e67ed38d74 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:22.987986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13a58-efb0-48aa-894e-f3e67ed38d74 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:22.988243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13a58-efb0-48aa-894e-f3e67ed38d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:23.023147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1be13a58-efb0-48aa-894e-f3e67ed38d74 None None] MFA Rules not processed for user `16dc67eb7c164a2fb9ce650c032e1340`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:23.030199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1be13a58-efb0-48aa-894e-f3e67ed38d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:23.089870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1262/2476] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:22 2021] PUT /identity/v3/projects/9b120e4df5c742d5b4623340825aa939/users/d32722b97d954803bcada8be18293332/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:23.098987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa854-b032-4087-9e5f-c7017a7c65b2 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:23.191623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1215/2477] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:22 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:23.238383 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa854-b032-4087-9e5f-c7017a7c65b2 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:23.246609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb621c14-0554-43c6-afdf-a1fe543ef44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:23.247714 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb621c14-0554-43c6-afdf-a1fe543ef44d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:23.247999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb621c14-0554-43c6-afdf-a1fe543ef44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:23.249035 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb621c14-0554-43c6-afdf-a1fe543ef44d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:23.249218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb621c14-0554-43c6-afdf-a1fe543ef44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:23.251001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb621c14-0554-43c6-afdf-a1fe543ef44d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:23.270169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1263/2478] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:23 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:16:23.271411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be13a58-efb0-48aa-894e-f3e67ed38d74 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:23.283228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be13a58-efb0-48aa-894e-f3e67ed38d74 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:23.302708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:23.305593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:23.305593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:23.305593 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] PATH_INFO: `/v3/projects/9b120e4df5c742d5b4623340825aa939/users/d32722b97d954803bcada8be18293332/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:23.311033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b120e4df5c742d5b4623340825aa939, user_id=d32722b97d954803bcada8be18293332, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:23.313728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:23.357113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23016b-0be2-4a72-a203-ece443496eb0 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:23.357441 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23016b-0be2-4a72-a203-ece443496eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:23.357675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23016b-0be2-4a72-a203-ece443496eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:23.358021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1216/2479] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:23 2021] PUT /identity/v3/projects/9b120e4df5c742d5b4623340825aa939/users/d32722b97d954803bcada8be18293332/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:23.396566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4f23016b-0be2-4a72-a203-ece443496eb0 None None] MFA Rules not processed for user `d32722b97d954803bcada8be18293332`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:23.398667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4f23016b-0be2-4a72-a203-ece443496eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:23.564530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1264/2480] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:23 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:23.695421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:23.701522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:23.942766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bcdb3-f68c-4daa-bff9-86913b291617 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:23.942766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:23.942766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:23.942766 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:23.943994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:23.943994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:23.943994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:23.953706 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1217/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:23 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:24.079077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23016b-0be2-4a72-a203-ece443496eb0 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:24.088199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4f23016b-0be2-4a72-a203-ece443496eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:24.219248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23016b-0be2-4a72-a203-ece443496eb0 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:24.254997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:24.257839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:24.263954 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:24.264712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] PATH_INFO: `/v3/projects/84f177f15b8a4712ab2685c711923771` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:24.268055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f177f15b8a4712ab2685c711923771)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:24.271012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:24.277681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:24.279342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:24.321288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72604c0-303e-43c2-a3e9-2468e47f2ff2 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:24.342219 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:24.343079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:24.343463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:24.343833 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:24.349488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:24.475577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f177f15b8a4712ab2685c711923771', 'request_id': 'req-0ee28941-61e2-49a9-815c-2c7df59bdb17'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:24.495403 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:24.497439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:24.514644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1218/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:24 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:16:24.560020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f177f15b8a4712ab2685c711923771', 'request_id': 'req-0ee28941-61e2-49a9-815c-2c7df59bdb17'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:24.568682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f177f15b8a4712ab2685c711923771', 'request_id': 'req-0ee28941-61e2-49a9-815c-2c7df59bdb17'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:24.586079 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] The token cache is being invalidate because project 84f177f15b8a4712ab2685c711923771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:24.586527 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:24.590960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-0ee28941-61e2-49a9-815c-2c7df59bdb17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:24.627096 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1265/2483] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:24 2021] DELETE /identity/v3/projects/84f177f15b8a4712ab2685c711923771 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:24.628499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:24.639964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ca03-7bce-4376-83f4-a934870d44ae service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:24.726797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:24.728487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:24.729004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:24.729531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] PATH_INFO: `/v3/users/9b6c11f2b5064682be865faf8562ff74` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:24.732602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6c11f2b5064682be865faf8562ff74)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:24.754752 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:25.066465 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6c11f2b5064682be865faf8562ff74'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:25.068062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6c11f2b5064682be865faf8562ff74'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:25.069768 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6c11f2b5064682be865faf8562ff74'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:25.131183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6c11f2b5064682be865faf8562ff74'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:25.179516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6c11f2b5064682be865faf8562ff74'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:25.215289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1219/2484] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:24 2021] DELETE /identity/v3/users/9b6c11f2b5064682be865faf8562ff74 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:25.524063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b826-6ea5-40d2-a674-078171dfeac2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:25.531874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b826-6ea5-40d2-a674-078171dfeac2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:25.531874 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b826-6ea5-40d2-a674-078171dfeac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:25.610257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-bd45b826-6ea5-40d2-a674-078171dfeac2 None None] MFA Rules not processed for user `147031f43265455081cb539cf5717147`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:25.615819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bd45b826-6ea5-40d2-a674-078171dfeac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:25.777407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1266/2485] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:25 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:25.786405 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:25.794247 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:25.993015 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c58d5-ef78-4796-932a-3d2415f02e8c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:26.020426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c0ed-1ca2-4510-b907-f31ee6639d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:26.041788 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c0ed-1ca2-4510-b907-f31ee6639d33 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:26.044455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c0ed-1ca2-4510-b907-f31ee6639d33 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:26.045026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c0ed-1ca2-4510-b907-f31ee6639d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:26.051678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9e69c0ed-1ca2-4510-b907-f31ee6639d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:26.214215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c0ed-1ca2-4510-b907-f31ee6639d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:26.216890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c0ed-1ca2-4510-b907-f31ee6639d33 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:26.243297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1220/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:25 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:26.341825 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45b826-6ea5-40d2-a674-078171dfeac2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:26.345722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bd45b826-6ea5-40d2-a674-078171dfeac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:26.526098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45b826-6ea5-40d2-a674-078171dfeac2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:26.532253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:26.533571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:26.534073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:26.534589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] PATH_INFO: `/v3/projects/9d52787f317446b097c0caab4bf7994b` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:26.537276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d52787f317446b097c0caab4bf7994b)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:26.540485 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:26.775736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d52787f317446b097c0caab4bf7994b', 'request_id': 'req-45e338b1-6066-4437-ae0b-a0031a9aa5c6'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:26.847003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d52787f317446b097c0caab4bf7994b', 'request_id': 'req-45e338b1-6066-4437-ae0b-a0031a9aa5c6'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:26.870098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d52787f317446b097c0caab4bf7994b', 'request_id': 'req-45e338b1-6066-4437-ae0b-a0031a9aa5c6'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:26.894921 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] The token cache is being invalidate because project 9d52787f317446b097c0caab4bf7994b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:26.895872 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:26.896486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-45e338b1-6066-4437-ae0b-a0031a9aa5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:26.903897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1267/2487] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:26 2021] DELETE /identity/v3/projects/9d52787f317446b097c0caab4bf7994b => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:26.907884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bbdc8-acce-4f86-b618-a811afed5ac8 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:26.907884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bbdc8-acce-4f86-b618-a811afed5ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:26.907884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bbdc8-acce-4f86-b618-a811afed5ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:26.948280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-6b9bbdc8-acce-4f86-b618-a811afed5ac8 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:26.950447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6b9bbdc8-acce-4f86-b618-a811afed5ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:27.095643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1221/2488] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:27.097652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde255-afdb-4d42-8e2d-84a08b92a10c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:27.098352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde255-afdb-4d42-8e2d-84a08b92a10c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:27.098535 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde255-afdb-4d42-8e2d-84a08b92a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:27.162682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-77dde255-afdb-4d42-8e2d-84a08b92a10c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:27.175318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-77dde255-afdb-4d42-8e2d-84a08b92a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:27.202903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1268/2489] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:27.210225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bbdc8-acce-4f86-b618-a811afed5ac8 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:27.222818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bbdc8-acce-4f86-b618-a811afed5ac8 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:27.230905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:27.231956 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:27.232401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:27.233454 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:27.234608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:27.235080 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:27.236707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:27.261833 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dde255-afdb-4d42-8e2d-84a08b92a10c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:27.271411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1222/2490] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:16:27.274077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dde255-afdb-4d42-8e2d-84a08b92a10c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:27.292007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdb18a-8311-4f27-9c57-8651e9058bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:27.292007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb18a-8311-4f27-9c57-8651e9058bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:27.292007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb18a-8311-4f27-9c57-8651e9058bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:27.292007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdb18a-8311-4f27-9c57-8651e9058bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:27.292633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdb18a-8311-4f27-9c57-8651e9058bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:27.296561 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdb18a-8311-4f27-9c57-8651e9058bb8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:27.399593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1269/2491] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:27 2021] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:27.405205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:27.425192 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c552db0-37f0-4d07-b2fa-6cfa5f81a726 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:27.582395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25e350-c55c-4681-97b5-5414a60596bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:27.583868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25e350-c55c-4681-97b5-5414a60596bf admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:27.584256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25e350-c55c-4681-97b5-5414a60596bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:27.584658 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25e350-c55c-4681-97b5-5414a60596bf admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:27.585674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25e350-c55c-4681-97b5-5414a60596bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:27.588335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25e350-c55c-4681-97b5-5414a60596bf admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:27.708834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1223/2492] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:27 2021] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:16:27.710181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdb18a-8311-4f27-9c57-8651e9058bb8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:27.740473 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdb18a-8311-4f27-9c57-8651e9058bb8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:27.749404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b810-bb94-4f9b-a7c5-cb3a010c1bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:27.750107 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b810-bb94-4f9b-a7c5-cb3a010c1bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:27.750392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b810-bb94-4f9b-a7c5-cb3a010c1bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:27.750893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b810-bb94-4f9b-a7c5-cb3a010c1bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:27.751657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6b810-bb94-4f9b-a7c5-cb3a010c1bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:27.753349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6b810-bb94-4f9b-a7c5-cb3a010c1bd4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:27.796010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1270/2493] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:27 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:27.803932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25e350-c55c-4681-97b5-5414a60596bf admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:27.826146 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25e350-c55c-4681-97b5-5414a60596bf admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:27.831957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aad726-53b4-4553-9243-3a5a043e8ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:27.833407 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aad726-53b4-4553-9243-3a5a043e8ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:27.833826 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aad726-53b4-4553-9243-3a5a043e8ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:27.834233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aad726-53b4-4553-9243-3a5a043e8ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:27.842753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aad726-53b4-4553-9243-3a5a043e8ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:27.845150 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aad726-53b4-4553-9243-3a5a043e8ce1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:27.884739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1224/2494] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:27 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:27.885734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b810-bb94-4f9b-a7c5-cb3a010c1bd4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:27.896040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b810-bb94-4f9b-a7c5-cb3a010c1bd4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:27.900832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:27.901780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:27.902059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:27.902330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] PATH_INFO: `/v3/projects/5f1a88e4d3cf4640b92be771996d949e/users/66f23603f3d64e40b27051004102a506/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:27.922730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1a88e4d3cf4640b92be771996d949e, user_id=66f23603f3d64e40b27051004102a506, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:27.925447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:28.300287 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1271/2495] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:27 2021] PUT /identity/v3/projects/5f1a88e4d3cf4640b92be771996d949e/users/66f23603f3d64e40b27051004102a506/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:28.311447 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca0c-3677-4d87-bc71-f7db724fad15 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:28.312029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca0c-3677-4d87-bc71-f7db724fad15 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:28.312734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca0c-3677-4d87-bc71-f7db724fad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:28.407253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-fb2cca0c-3677-4d87-bc71-f7db724fad15 None None] MFA Rules not processed for user `66f23603f3d64e40b27051004102a506`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:28.408608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fb2cca0c-3677-4d87-bc71-f7db724fad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:28.531756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1225/2496] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:28 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:28.542506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:28.545280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:28.724938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d6fc6-acdd-44c4-9803-4a16ed776096 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:28.730836 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25d7a4-2ca7-4691-ab27-237693d77999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:28.731870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d7a4-2ca7-4691-ab27-237693d77999 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:28.732318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d7a4-2ca7-4691-ab27-237693d77999 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:28.732887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d7a4-2ca7-4691-ab27-237693d77999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:28.744132 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25d7a4-2ca7-4691-ab27-237693d77999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:28.750016 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25d7a4-2ca7-4691-ab27-237693d77999 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:28.781418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1272/2497] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:28 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:40.031130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cca0c-3677-4d87-bc71-f7db724fad15 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:40.033370 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fb2cca0c-3677-4d87-bc71-f7db724fad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:40.114145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cca0c-3677-4d87-bc71-f7db724fad15 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:40.122973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:40.123971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:40.124251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:40.124526 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] PATH_INFO: `/v3/users/57e3d00871684c91a6ec9fe83a6331c9` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:40.125777 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e3d00871684c91a6ec9fe83a6331c9)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:40.128071 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:40.399661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e3d00871684c91a6ec9fe83a6331c9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:40.400326 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e3d00871684c91a6ec9fe83a6331c9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:40.400927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e3d00871684c91a6ec9fe83a6331c9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:40.512980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e3d00871684c91a6ec9fe83a6331c9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:40.527564 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e3d00871684c91a6ec9fe83a6331c9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:40.545269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1226/2498] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:40 2021] DELETE /identity/v3/users/57e3d00871684c91a6ec9fe83a6331c9 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:40.549886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024eb2da-7c5b-4f6e-aec9-e3a75e7952f9 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:40.550709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024eb2da-7c5b-4f6e-aec9-e3a75e7952f9 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:40.550709 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024eb2da-7c5b-4f6e-aec9-e3a75e7952f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:40.570615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-024eb2da-7c5b-4f6e-aec9-e3a75e7952f9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:40.570615 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-024eb2da-7c5b-4f6e-aec9-e3a75e7952f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:40.641103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1273/2499] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:40.656646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:40.656646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:40.721026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763dfc6-ca14-4ff2-a70c-e88ab529faf1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:40.727497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49906513-a270-4f0e-b0e8-e564e589c2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:40.730044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906513-a270-4f0e-b0e8-e564e589c2ff service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:40.730044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906513-a270-4f0e-b0e8-e564e589c2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:40.730044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49906513-a270-4f0e-b0e8-e564e589c2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:40.742118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49906513-a270-4f0e-b0e8-e564e589c2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:40.743629 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49906513-a270-4f0e-b0e8-e564e589c2ff service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:40.754063 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1227/2500] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:41.405352 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024eb2da-7c5b-4f6e-aec9-e3a75e7952f9 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:41.408417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-024eb2da-7c5b-4f6e-aec9-e3a75e7952f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:41.430680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024eb2da-7c5b-4f6e-aec9-e3a75e7952f9 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:41.443320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:41.451694 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:41.451999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:41.452494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] PATH_INFO: `/v3/projects/df71ee1e35a44f0191dcd04c01e72c08` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:41.454100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df71ee1e35a44f0191dcd04c01e72c08)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:41.464085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:41.597737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df71ee1e35a44f0191dcd04c01e72c08', 'request_id': 'req-78802265-310c-4e23-b66f-ca6b3c390871'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:41.695753 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df71ee1e35a44f0191dcd04c01e72c08', 'request_id': 'req-78802265-310c-4e23-b66f-ca6b3c390871'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:41.703989 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df71ee1e35a44f0191dcd04c01e72c08', 'request_id': 'req-78802265-310c-4e23-b66f-ca6b3c390871'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:41.718040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] The token cache is being invalidate because project df71ee1e35a44f0191dcd04c01e72c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:41.718342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:41.719268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:41.720996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1274/2501] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:41 2021] DELETE /identity/v3/projects/df71ee1e35a44f0191dcd04c01e72c08 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:41.725984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49906513-a270-4f0e-b0e8-e564e589c2ff service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:41.737495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49906513-a270-4f0e-b0e8-e564e589c2ff service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:41.803012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:41.804134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:41.804415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:41.804685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] PATH_INFO: `/v3/users/8c18fff6e5074d959df6cdf4f13580bf` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:41.806320 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c18fff6e5074d959df6cdf4f13580bf)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:41.808339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:41.992513 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c18fff6e5074d959df6cdf4f13580bf'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:41.993167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c18fff6e5074d959df6cdf4f13580bf'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:41.993810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c18fff6e5074d959df6cdf4f13580bf'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.078980 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c18fff6e5074d959df6cdf4f13580bf'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.094005 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c18fff6e5074d959df6cdf4f13580bf'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.110934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1228/2502] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:41 2021] DELETE /identity/v3/users/8c18fff6e5074d959df6cdf4f13580bf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:42.213695 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:42.221717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:42.236110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78802265-310c-4e23-b66f-ca6b3c390871 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:42.306340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:42.307356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:42.313466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:42.313466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] PATH_INFO: `/v3/users/68268c0fd6bb4840b838a1790a77a46d` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:42.313466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68268c0fd6bb4840b838a1790a77a46d)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:42.313466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:42.499282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68268c0fd6bb4840b838a1790a77a46d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.500060 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68268c0fd6bb4840b838a1790a77a46d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.500684 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68268c0fd6bb4840b838a1790a77a46d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.559627 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68268c0fd6bb4840b838a1790a77a46d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.575475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-20a46ae3-e6df-484f-935e-a9726fcf2619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68268c0fd6bb4840b838a1790a77a46d'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.586895 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:42.590383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:42.600285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1275/2503] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:42 2021] DELETE /identity/v3/users/68268c0fd6bb4840b838a1790a77a46d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:42.605372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189005b-a08b-4282-bfa7-15a1d960ed46 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:42.605646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189005b-a08b-4282-bfa7-15a1d960ed46 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:42.605933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189005b-a08b-4282-bfa7-15a1d960ed46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:42.611479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca01c6-26a2-42a6-b484-c6d457886ea1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:42.625499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-1189005b-a08b-4282-bfa7-15a1d960ed46 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:42.631249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1189005b-a08b-4282-bfa7-15a1d960ed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:42.682008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:42.683441 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:42.683722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:42.683994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] PATH_INFO: `/v3/projects/1f4858f0e9344557922fc70f7157d0d6` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:42.685262 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4858f0e9344557922fc70f7157d0d6)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:42.687259 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:42.691281 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1276/2504] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:42.705905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189005b-a08b-4282-bfa7-15a1d960ed46 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:42.707965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1189005b-a08b-4282-bfa7-15a1d960ed46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:42.770439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189005b-a08b-4282-bfa7-15a1d960ed46 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:42.773966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:42.774812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:42.775119 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:42.775388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:42.785149 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:42.786611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:42.796783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1277/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:42.811799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4858f0e9344557922fc70f7157d0d6', 'request_id': 'req-5b079571-59ec-4995-b9a6-cf23234cbefb'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.884807 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4858f0e9344557922fc70f7157d0d6', 'request_id': 'req-5b079571-59ec-4995-b9a6-cf23234cbefb'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.891391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4858f0e9344557922fc70f7157d0d6', 'request_id': 'req-5b079571-59ec-4995-b9a6-cf23234cbefb'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.908500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] The token cache is being invalidate because project 1f4858f0e9344557922fc70f7157d0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:42.908500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.908500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:42.909859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1229/2506] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:42 2021] DELETE /identity/v3/projects/1f4858f0e9344557922fc70f7157d0d6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:42.911650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:42.913400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:42.927782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555eca-617f-4135-9b8c-e054dedb88a9 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:42.986734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:42.987620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:42.987910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:42.988178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] PATH_INFO: `/v3/users/d32722b97d954803bcada8be18293332` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:42.989630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32722b97d954803bcada8be18293332)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:42.991699 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:43.176272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32722b97d954803bcada8be18293332'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.177168 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32722b97d954803bcada8be18293332'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.177873 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32722b97d954803bcada8be18293332'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.246575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:43.253952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:43.261002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b079571-59ec-4995-b9a6-cf23234cbefb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:43.268072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:43.268982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:43.271002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:43.271404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] PATH_INFO: `/v3/projects/7c547cfc08f04fe3a7bbd5fe890899df` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:43.273986 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c547cfc08f04fe3a7bbd5fe890899df)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:43.274424 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32722b97d954803bcada8be18293332'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.278469 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:43.291394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32722b97d954803bcada8be18293332'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.305742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1278/2507] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:42 2021] DELETE /identity/v3/users/d32722b97d954803bcada8be18293332 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:43.461332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c547cfc08f04fe3a7bbd5fe890899df', 'request_id': 'req-ba7a1478-5d76-4607-93f1-69a345456f72'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.560214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c547cfc08f04fe3a7bbd5fe890899df', 'request_id': 'req-ba7a1478-5d76-4607-93f1-69a345456f72'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.568958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c547cfc08f04fe3a7bbd5fe890899df', 'request_id': 'req-ba7a1478-5d76-4607-93f1-69a345456f72'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.590084 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] The token cache is being invalidate because project 7c547cfc08f04fe3a7bbd5fe890899df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:43.590707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.592882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-ba7a1478-5d76-4607-93f1-69a345456f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:43.596951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1230/2508] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:43 2021] DELETE /identity/v3/projects/7c547cfc08f04fe3a7bbd5fe890899df => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:43.832496 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:43.841570 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:43.916642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38f1d6-bc15-4054-8912-13902b16fc62 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:43.983366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:43.984242 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:43.984524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:43.984797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] PATH_INFO: `/v3/projects/9b120e4df5c742d5b4623340825aa939` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:43.986098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b120e4df5c742d5b4623340825aa939)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:43.988061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:44.122084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b120e4df5c742d5b4623340825aa939', 'request_id': 'req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:44.224556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b120e4df5c742d5b4623340825aa939', 'request_id': 'req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:44.224556 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b120e4df5c742d5b4623340825aa939', 'request_id': 'req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:44.242517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] The token cache is being invalidate because project 9b120e4df5c742d5b4623340825aa939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:44.242940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:44.244837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-8b4d50a4-4d41-4fe1-bb80-88329aafbc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:44.251008 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1279/2509] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:43 2021] DELETE /identity/v3/projects/9b120e4df5c742d5b4623340825aa939 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:44.267688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132608-0438-4235-b37b-b87161b4596a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:44.268291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132608-0438-4235-b37b-b87161b4596a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:44.268291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27132608-0438-4235-b37b-b87161b4596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:44.308487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-27132608-0438-4235-b37b-b87161b4596a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:44.310621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-27132608-0438-4235-b37b-b87161b4596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:44.405357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1231/2510] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:44.429769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6275f-e9d6-4cd5-b505-544ab4054a01 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:44.430216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6275f-e9d6-4cd5-b505-544ab4054a01 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:44.430621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6275f-e9d6-4cd5-b505-544ab4054a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:44.451082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-6dd6275f-e9d6-4cd5-b505-544ab4054a01 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:44.452456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6dd6275f-e9d6-4cd5-b505-544ab4054a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:44.460715 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1280/2511] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:44.465008 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132608-0438-4235-b37b-b87161b4596a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:44.474434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27132608-0438-4235-b37b-b87161b4596a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:44.480211 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:44.481512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:44.481512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:44.481724 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:44.482305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:16:44.482640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:44.484220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:44.496699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1232/2512] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:16:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:16:44.502164 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6275f-e9d6-4cd5-b505-544ab4054a01 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:44.511839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6275f-e9d6-4cd5-b505-544ab4054a01 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:44.516562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32df0-0875-4a64-87d2-66d563bad5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:44.517235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32df0-0875-4a64-87d2-66d563bad5fc admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:44.517517 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32df0-0875-4a64-87d2-66d563bad5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:44.517792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32df0-0875-4a64-87d2-66d563bad5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:44.518496 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32df0-0875-4a64-87d2-66d563bad5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:44.520635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32df0-0875-4a64-87d2-66d563bad5fc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:44.633443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1281/2513] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:16:44 2021] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:16:44.635196 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:44.646660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08247a-7f8d-4ca6-9ae6-c207827b9be4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:44.731521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b47b-a0b3-4a17-ab03-9363b795b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:44.734828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b47b-a0b3-4a17-ab03-9363b795b9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:44.734828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b47b-a0b3-4a17-ab03-9363b795b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:44.734828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b47b-a0b3-4a17-ab03-9363b795b9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:44.734828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18b47b-a0b3-4a17-ab03-9363b795b9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:44.735711 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18b47b-a0b3-4a17-ab03-9363b795b9c9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:44.817334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1233/2514] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:16:44 2021] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:16:44.823151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32df0-0875-4a64-87d2-66d563bad5fc admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:44.835001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32df0-0875-4a64-87d2-66d563bad5fc admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:44.840389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b143a0-7f4e-452b-9063-a96308f52480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:44.841106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b143a0-7f4e-452b-9063-a96308f52480 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:44.841385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b143a0-7f4e-452b-9063-a96308f52480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:44.841667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b143a0-7f4e-452b-9063-a96308f52480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:44.842423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b143a0-7f4e-452b-9063-a96308f52480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:44.844697 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b143a0-7f4e-452b-9063-a96308f52480 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:44.856200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1282/2515] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:44.860273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b47b-a0b3-4a17-ab03-9363b795b9c9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:44.870499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b47b-a0b3-4a17-ab03-9363b795b9c9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:44.875329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130da273-c3d5-481c-bf8a-252bdbd18767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:44.876032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da273-c3d5-481c-bf8a-252bdbd18767 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:44.876299 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da273-c3d5-481c-bf8a-252bdbd18767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:44.876575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130da273-c3d5-481c-bf8a-252bdbd18767 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:44.877325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130da273-c3d5-481c-bf8a-252bdbd18767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:44.879235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130da273-c3d5-481c-bf8a-252bdbd18767 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:44.900937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1234/2516] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:16:44.910624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b143a0-7f4e-452b-9063-a96308f52480 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:44.922021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b143a0-7f4e-452b-9063-a96308f52480 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:44.927049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:44.927940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:44.928218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:44.928657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] PATH_INFO: `/v3/projects/20af76921cde4b01b02a3b8aef4f7e37/users/d105ece49782431a90ab6856e0c20898/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:44.945273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20af76921cde4b01b02a3b8aef4f7e37, user_id=d105ece49782431a90ab6856e0c20898, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:44.948027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:45.024771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1283/2517] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:16:44 2021] PUT /identity/v3/projects/20af76921cde4b01b02a3b8aef4f7e37/users/d105ece49782431a90ab6856e0c20898/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:45.037709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332c19-e0ca-44e4-ac67-7bd020b6ee77 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:45.038041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332c19-e0ca-44e4-ac67-7bd020b6ee77 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:45.038325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b332c19-e0ca-44e4-ac67-7bd020b6ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:45.065476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-2b332c19-e0ca-44e4-ac67-7bd020b6ee77 None None] MFA Rules not processed for user `d105ece49782431a90ab6856e0c20898`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:45.066858 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2b332c19-e0ca-44e4-ac67-7bd020b6ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:45.138310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1235/2518] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:45 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:45.148451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:45.150235 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:45.256381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a63e8-b8b5-4a33-8e5c-8e0b70b9fa50 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:45.263218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272c038-3671-4b95-b655-0ba3ba1c2776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:45.263218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272c038-3671-4b95-b655-0ba3ba1c2776 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:45.263218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272c038-3671-4b95-b655-0ba3ba1c2776 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:45.263218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272c038-3671-4b95-b655-0ba3ba1c2776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:45.275302 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272c038-3671-4b95-b655-0ba3ba1c2776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:45.277680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272c038-3671-4b95-b655-0ba3ba1c2776 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:45.288520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1284/2519] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:45 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:16:47.679930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a33c-8ad6-4cf1-abe9-c8b9245a9836 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:47.680725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a33c-8ad6-4cf1-abe9-c8b9245a9836 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:47.680725 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a33c-8ad6-4cf1-abe9-c8b9245a9836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:47.703219 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-0b29a33c-8ad6-4cf1-abe9-c8b9245a9836 None None] MFA Rules not processed for user `d105ece49782431a90ab6856e0c20898`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:47.705619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0b29a33c-8ad6-4cf1-abe9-c8b9245a9836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:47.717545 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1236/2520] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:47 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:48.753288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4703-2092-402c-8ed9-c6e139492739 None None] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:48.753849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4703-2092-402c-8ed9-c6e139492739 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:48.753849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c4703-2092-402c-8ed9-c6e139492739 None None] PATH_INFO: `/` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:48.755675 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1285/2521] 10.222.0.16 () {54 vars in 921 bytes} [Thu Nov 11 17:16:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:16:48.763737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d9d7-87d2-4986-b26d-25fede552751 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:48.764288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d9d7-87d2-4986-b26d-25fede552751 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:48.764500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d9d7-87d2-4986-b26d-25fede552751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:48.841145 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-4911d9d7-87d2-4986-b26d-25fede552751 None None] MFA Rules not processed for user `0941777cfcbf4532be31ca001ced8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:48.842530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4911d9d7-87d2-4986-b26d-25fede552751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:48.960839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1237/2522] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Nov 11 17:16:48 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:48.978642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c4703-2092-402c-8ed9-c6e139492739 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:48.980755 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b96c4703-2092-402c-8ed9-c6e139492739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:49.063587 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c4703-2092-402c-8ed9-c6e139492739 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:49.067462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c0599-8b62-4a87-a3ec-30b745732fe2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a061423c1f646b8892d646979f84f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:49.068123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0599-8b62-4a87-a3ec-30b745732fe2 service glance] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:49.068404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0599-8b62-4a87-a3ec-30b745732fe2 service glance] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:49.068680 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0599-8b62-4a87-a3ec-30b745732fe2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:49.083763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c0599-8b62-4a87-a3ec-30b745732fe2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:49.085411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c0599-8b62-4a87-a3ec-30b745732fe2 service glance] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:49.098727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1286/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:49.458338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593c78-7070-43ea-a7da-1fab3f75eb1e None None] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:49.458828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593c78-7070-43ea-a7da-1fab3f75eb1e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:49.459124 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593c78-7070-43ea-a7da-1fab3f75eb1e None None] PATH_INFO: `/` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:49.460967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1238/2524] 10.222.0.16 () {54 vars in 921 bytes} [Thu Nov 11 17:16:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 11 17:16:49.468063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513da26-2ff2-4a0d-8655-ae5f794ba759 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:49.468549 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513da26-2ff2-4a0d-8655-ae5f794ba759 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:49.468922 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513da26-2ff2-4a0d-8655-ae5f794ba759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:49.501784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-8513da26-2ff2-4a0d-8655-ae5f794ba759 None None] MFA Rules not processed for user `872474833e2f49c9a9ceccef8914e2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:49.501784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8513da26-2ff2-4a0d-8655-ae5f794ba759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:49.575909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1287/2525] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Nov 11 17:16:49 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:16:49.591882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a593c78-7070-43ea-a7da-1fab3f75eb1e None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:49.594437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8a593c78-7070-43ea-a7da-1fab3f75eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:49.618897 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a593c78-7070-43ea-a7da-1fab3f75eb1e None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:49.625423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c2364-d9fd-4a37-9720-c88b43eb9c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:49.626631 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c2364-d9fd-4a37-9720-c88b43eb9c13 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:49.627176 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c2364-d9fd-4a37-9720-c88b43eb9c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:49.627662 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c2364-d9fd-4a37-9720-c88b43eb9c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:49.641060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c2364-d9fd-4a37-9720-c88b43eb9c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:49.642507 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c2364-d9fd-4a37-9720-c88b43eb9c13 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:49.652204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1239/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:16:54.439837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513da26-2ff2-4a0d-8655-ae5f794ba759 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:54.441323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8513da26-2ff2-4a0d-8655-ae5f794ba759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:54.520204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513da26-2ff2-4a0d-8655-ae5f794ba759 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:54.526519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:54.527766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:54.528241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:54.528801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] PATH_INFO: `/v3/users/12a89e3ae4d84926861145d1ba8eded2` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:54.530657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a89e3ae4d84926861145d1ba8eded2)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:54.532855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:54.755201 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a89e3ae4d84926861145d1ba8eded2'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:54.756057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a89e3ae4d84926861145d1ba8eded2'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:54.757063 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a89e3ae4d84926861145d1ba8eded2'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:54.823687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a89e3ae4d84926861145d1ba8eded2'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:54.849349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a89e3ae4d84926861145d1ba8eded2'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:54.866663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1288/2527] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:16:54 2021] DELETE /identity/v3/users/12a89e3ae4d84926861145d1ba8eded2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:16:54.868691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1df4-9eed-44ee-85f6-43159d10d604 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:54.869161 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1df4-9eed-44ee-85f6-43159d10d604 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:54.870985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1df4-9eed-44ee-85f6-43159d10d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:54.906134 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-873f1df4-9eed-44ee-85f6-43159d10d604 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:54.907552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-873f1df4-9eed-44ee-85f6-43159d10d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:55.027968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1240/2528] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:55.040288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:55.043019 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:55.178393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e758-dc49-414b-bbb4-0ca1aa89c406 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:55.186930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:55.187631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:55.195944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:55.195944 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:55.214115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:55.215863 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:55.228024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1289/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:16:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:16:56.618327 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf155-58c9-4031-b25f-2335daee9edd None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:56.618905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf155-58c9-4031-b25f-2335daee9edd None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:56.618905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf155-58c9-4031-b25f-2335daee9edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:56.649151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-906cf155-58c9-4031-b25f-2335daee9edd None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:56.650609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-906cf155-58c9-4031-b25f-2335daee9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:56.722733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1241/2530] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:16:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:16:56.731466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:56.733058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:56.802453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657669-4ff2-41ea-ad2a-62add37b9667 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:56.808542 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0351418-6d59-4a81-8b82-985e230e35dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:56.809279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351418-6d59-4a81-8b82-985e230e35dd service swift] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:56.809633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351418-6d59-4a81-8b82-985e230e35dd service swift] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:56.809966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0351418-6d59-4a81-8b82-985e230e35dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:56.819294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0351418-6d59-4a81-8b82-985e230e35dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:56.821082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0351418-6d59-4a81-8b82-985e230e35dd service swift] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:56.830516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1290/2531] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:16:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:16:56.831011 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf155-58c9-4031-b25f-2335daee9edd None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:16:56.837458 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-906cf155-58c9-4031-b25f-2335daee9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:56.851505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf155-58c9-4031-b25f-2335daee9edd None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:16:56.856676 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:16:56.857642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:56.858007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:56.858268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] PATH_INFO: `/v3/projects/9de64ce3e5334c68862683fdd1a48867` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:56.859610 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de64ce3e5334c68862683fdd1a48867)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:16:56.861787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:16:57.089622 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de64ce3e5334c68862683fdd1a48867', 'request_id': 'req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:57.170030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de64ce3e5334c68862683fdd1a48867', 'request_id': 'req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:57.180254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de64ce3e5334c68862683fdd1a48867', 'request_id': 'req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:57.202197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] The token cache is being invalidate because project 9de64ce3e5334c68862683fdd1a48867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:16:57.202579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:57.203230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:16:57.205228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1242/2532] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:16:56 2021] DELETE /identity/v3/projects/9de64ce3e5334c68862683fdd1a48867 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:16:57.341793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914d30-6036-476e-b35b-b69f0c3c3eb5 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:16:57.342154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914d30-6036-476e-b35b-b69f0c3c3eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:16:57.342453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914d30-6036-476e-b35b-b69f0c3c3eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:16:57.392117 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-bb914d30-6036-476e-b35b-b69f0c3c3eb5 None None] MFA Rules not processed for user `97c82e393b164313ad7a95eca6b65c26`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:16:57.393416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bb914d30-6036-476e-b35b-b69f0c3c3eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:16:57.514331 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1291/2533] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:16:57 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:20.172271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:20.174804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:20.278648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1cee-2c2f-43a7-9e42-f6e7128d1a96 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:20.283799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db055fddc41c4eb0ba1c3b410e1e8e03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:20.284445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:20.284759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:20.285033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:20.286900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:20.299128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:20.300716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:20.312028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1243/2534] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:17:20 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:17:21.691439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5442ca-2ea0-4d5b-852e-b7fe5bc09387 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:21.691960 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5442ca-2ea0-4d5b-852e-b7fe5bc09387 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:21.692052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5442ca-2ea0-4d5b-852e-b7fe5bc09387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:21.742189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-8e5442ca-2ea0-4d5b-852e-b7fe5bc09387 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:21.743477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8e5442ca-2ea0-4d5b-852e-b7fe5bc09387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:21.822500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1292/2535] 10.222.0.16 () {58 vars in 967 bytes} [Thu Nov 11 17:17:21 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:21.849529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:21.851159 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:21.961586 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28655e0d-11a2-4b89-8812-2bc0687fc75e service placement] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:21.968117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13643cf-9a9f-4f6b-8005-07cbb58efcaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:21.968789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13643cf-9a9f-4f6b-8005-07cbb58efcaf service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:21.969066 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13643cf-9a9f-4f6b-8005-07cbb58efcaf service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:21.969340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13643cf-9a9f-4f6b-8005-07cbb58efcaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:21.983232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13643cf-9a9f-4f6b-8005-07cbb58efcaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:21.986681 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13643cf-9a9f-4f6b-8005-07cbb58efcaf service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:22.006205 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1244/2536] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:17:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:17:22.241177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15a15-5f8d-473d-b2a7-a2c36b197409 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:22.241459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15a15-5f8d-473d-b2a7-a2c36b197409 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:22.242434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b15a15-5f8d-473d-b2a7-a2c36b197409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:22.261893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e7b15a15-5f8d-473d-b2a7-a2c36b197409 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:22.263285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e7b15a15-5f8d-473d-b2a7-a2c36b197409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:22.271604 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1293/2537] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:17:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:22.290979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13643cf-9a9f-4f6b-8005-07cbb58efcaf service swift] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:22.304162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13643cf-9a9f-4f6b-8005-07cbb58efcaf service swift] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:22.315347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81056833-5557-48f7-b966-84547e562cf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:22.315347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81056833-5557-48f7-b966-84547e562cf6 service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:22.315347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81056833-5557-48f7-b966-84547e562cf6 service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:22.323748 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81056833-5557-48f7-b966-84547e562cf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:22.340347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81056833-5557-48f7-b966-84547e562cf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:22.343136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81056833-5557-48f7-b966-84547e562cf6 service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:22.351592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1245/2538] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:17:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:17:23.465893 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65477a0e-7ffb-4f7c-90a5-c5dbd86342f6 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:23.466434 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65477a0e-7ffb-4f7c-90a5-c5dbd86342f6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:23.466532 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65477a0e-7ffb-4f7c-90a5-c5dbd86342f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:23.486973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-65477a0e-7ffb-4f7c-90a5-c5dbd86342f6 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:23.496085 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-65477a0e-7ffb-4f7c-90a5-c5dbd86342f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:23.507208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1294/2539] 10.222.0.16 () {58 vars in 967 bytes} [Thu Nov 11 17:17:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:23.525402 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81056833-5557-48f7-b966-84547e562cf6 service swift] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:23.536808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81056833-5557-48f7-b966-84547e562cf6 service swift] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:23.543567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b682a9d-bf04-4be3-8c54-ce70977bbc81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:23.544395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b682a9d-bf04-4be3-8c54-ce70977bbc81 service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:23.544928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b682a9d-bf04-4be3-8c54-ce70977bbc81 service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:23.545296 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b682a9d-bf04-4be3-8c54-ce70977bbc81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:23.556049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b682a9d-bf04-4be3-8c54-ce70977bbc81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:23.559362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b682a9d-bf04-4be3-8c54-ce70977bbc81 service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:23.570457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1246/2540] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:17:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:17:24.180781 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d258-2ef1-4e7e-9f11-52bbe7109d55 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:24.181067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d258-2ef1-4e7e-9f11-52bbe7109d55 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:24.181340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6d258-2ef1-4e7e-9f11-52bbe7109d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:24.199436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a8f6d258-2ef1-4e7e-9f11-52bbe7109d55 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:24.200606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a8f6d258-2ef1-4e7e-9f11-52bbe7109d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:24.208335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1295/2541] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:17:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:24.221710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b682a9d-bf04-4be3-8c54-ce70977bbc81 service swift] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:24.232306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b682a9d-bf04-4be3-8c54-ce70977bbc81 service swift] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:24.237203 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc2363-b681-4679-9c70-63ecb75e93ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:24.237831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2363-b681-4679-9c70-63ecb75e93ff service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:24.238109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2363-b681-4679-9c70-63ecb75e93ff service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:24.238381 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2363-b681-4679-9c70-63ecb75e93ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:24.247261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc2363-b681-4679-9c70-63ecb75e93ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:24.249068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc2363-b681-4679-9c70-63ecb75e93ff service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:24.257592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1247/2542] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:17:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:17:24.950290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524aac-7dd9-4813-a48c-78fcf4df6295 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:24.950798 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524aac-7dd9-4813-a48c-78fcf4df6295 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:24.950892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524aac-7dd9-4813-a48c-78fcf4df6295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:24.968550 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-91524aac-7dd9-4813-a48c-78fcf4df6295 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:24.969734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-91524aac-7dd9-4813-a48c-78fcf4df6295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:24.977355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1296/2543] 10.222.0.16 () {58 vars in 967 bytes} [Thu Nov 11 17:17:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:24.990894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc2363-b681-4679-9c70-63ecb75e93ff service swift] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:25.001968 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc2363-b681-4679-9c70-63ecb75e93ff service swift] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:25.007049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719594f-b0d3-4fbc-9552-f82cd7f853a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:25.007697 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719594f-b0d3-4fbc-9552-f82cd7f853a5 service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:25.007977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719594f-b0d3-4fbc-9552-f82cd7f853a5 service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:25.008286 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719594f-b0d3-4fbc-9552-f82cd7f853a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:25.021325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719594f-b0d3-4fbc-9552-f82cd7f853a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:25.022975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719594f-b0d3-4fbc-9552-f82cd7f853a5 service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:25.032110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1248/2544] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:17:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:17:28.599300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91524aac-7dd9-4813-a48c-78fcf4df6295 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:28.600678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-91524aac-7dd9-4813-a48c-78fcf4df6295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:28.668226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91524aac-7dd9-4813-a48c-78fcf4df6295 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:28.672651 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:28.673631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:28.673932 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:28.674220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] PATH_INFO: `/v3/users/d105ece49782431a90ab6856e0c20898` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:28.675533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d105ece49782431a90ab6856e0c20898)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:28.677662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:28.930723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd105ece49782431a90ab6856e0c20898'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:28.931369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd105ece49782431a90ab6856e0c20898'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:28.932562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd105ece49782431a90ab6856e0c20898'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:28.997940 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd105ece49782431a90ab6856e0c20898'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:29.016772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd105ece49782431a90ab6856e0c20898'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:29.033612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1297/2545] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:17:28 2021] DELETE /identity/v3/users/d105ece49782431a90ab6856e0c20898 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:29.035325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9ada-e573-4342-867b-b33075ac43e8 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:29.035818 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9ada-e573-4342-867b-b33075ac43e8 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:29.035999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9ada-e573-4342-867b-b33075ac43e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:29.054224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b71d9ada-e573-4342-867b-b33075ac43e8 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:29.055634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b71d9ada-e573-4342-867b-b33075ac43e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:29.121773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1249/2546] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:29.131677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:29.133229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:29.194154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baf82b-e0ec-4a35-bee0-c3b92c88bfa6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:29.200074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2091d-9cf2-4be2-a4a8-665b76dc675d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:29.201017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2091d-9cf2-4be2-a4a8-665b76dc675d service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:29.201390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2091d-9cf2-4be2-a4a8-665b76dc675d service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:29.202268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2091d-9cf2-4be2-a4a8-665b76dc675d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:29.212257 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2091d-9cf2-4be2-a4a8-665b76dc675d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:29.213938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2091d-9cf2-4be2-a4a8-665b76dc675d service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:29.224162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1298/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:17:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:17:29.525256 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d9ada-e573-4342-867b-b33075ac43e8 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:29.526984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b71d9ada-e573-4342-867b-b33075ac43e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:29.547838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d9ada-e573-4342-867b-b33075ac43e8 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:29.565509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:29.566419 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:29.566731 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:29.567009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] PATH_INFO: `/v3/projects/20af76921cde4b01b02a3b8aef4f7e37` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:29.568557 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20af76921cde4b01b02a3b8aef4f7e37)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:29.571919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:29.733496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20af76921cde4b01b02a3b8aef4f7e37', 'request_id': 'req-78f8e05c-8165-4e1f-9b25-25c47b3bb716'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:29.820238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20af76921cde4b01b02a3b8aef4f7e37', 'request_id': 'req-78f8e05c-8165-4e1f-9b25-25c47b3bb716'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:29.827351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20af76921cde4b01b02a3b8aef4f7e37', 'request_id': 'req-78f8e05c-8165-4e1f-9b25-25c47b3bb716'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:29.842308 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] The token cache is being invalidate because project 20af76921cde4b01b02a3b8aef4f7e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:17:29.842641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:29.843333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-78f8e05c-8165-4e1f-9b25-25c47b3bb716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:29.844936 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1250/2548] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:17:29 2021] DELETE /identity/v3/projects/20af76921cde4b01b02a3b8aef4f7e37 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:29.852482 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff436bd-37bf-4577-8689-a4cb18a83c81 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:29.853266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff436bd-37bf-4577-8689-a4cb18a83c81 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:29.853266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff436bd-37bf-4577-8689-a4cb18a83c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:29.875359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-eff436bd-37bf-4577-8689-a4cb18a83c81 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:29.876515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-eff436bd-37bf-4577-8689-a4cb18a83c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:29.958676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1299/2549] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:29.967679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d99d-570e-4131-ac17-aab1b3ae45de None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:29.967963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d99d-570e-4131-ac17-aab1b3ae45de None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:29.968414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839d99d-570e-4131-ac17-aab1b3ae45de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:29.990281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-2839d99d-570e-4131-ac17-aab1b3ae45de None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:29.991832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2839d99d-570e-4131-ac17-aab1b3ae45de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:30.000434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1251/2550] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:30.005371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff436bd-37bf-4577-8689-a4cb18a83c81 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:30.016229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff436bd-37bf-4577-8689-a4cb18a83c81 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:30.021190 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:30.021913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:30.025284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:30.025284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:30.025284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:17:30.025284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:30.025284 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:30.046156 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1300/2551] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:17:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:17:30.047749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839d99d-570e-4131-ac17-aab1b3ae45de None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:30.066431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839d99d-570e-4131-ac17-aab1b3ae45de None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:30.077169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8c9ae-d7cf-446c-8e73-cc96888dd36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:30.077877 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c9ae-d7cf-446c-8e73-cc96888dd36c admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:30.078154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c9ae-d7cf-446c-8e73-cc96888dd36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:30.078433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c9ae-d7cf-446c-8e73-cc96888dd36c admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:30.079186 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8c9ae-d7cf-446c-8e73-cc96888dd36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:30.081148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8c9ae-d7cf-446c-8e73-cc96888dd36c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:30.195734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1252/2552] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:17:30 2021] POST /identity/v3/projects => generated 397 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:17:30.200593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:30.211240 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38baca5-d840-4345-b52a-996ad62c8f5d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:30.275324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a1458-f645-45d1-8f98-dc2afe468a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:30.276566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1458-f645-45d1-8f98-dc2afe468a78 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:30.276847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1458-f645-45d1-8f98-dc2afe468a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:30.277127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a1458-f645-45d1-8f98-dc2afe468a78 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:30.277837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a1458-f645-45d1-8f98-dc2afe468a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:30.279846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a1458-f645-45d1-8f98-dc2afe468a78 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:30.381864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1301/2553] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:17:30 2021] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:17:30.386910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8c9ae-d7cf-446c-8e73-cc96888dd36c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:30.397588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8c9ae-d7cf-446c-8e73-cc96888dd36c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:30.402522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c0dbf-18ac-4217-bc60-db78dc6a9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:30.403220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c0dbf-18ac-4217-bc60-db78dc6a9350 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:30.403504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c0dbf-18ac-4217-bc60-db78dc6a9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:30.403780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c0dbf-18ac-4217-bc60-db78dc6a9350 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:30.404524 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c0dbf-18ac-4217-bc60-db78dc6a9350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:30.406142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c0dbf-18ac-4217-bc60-db78dc6a9350 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:30.417120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1253/2554] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:17:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:17:30.421376 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a1458-f645-45d1-8f98-dc2afe468a78 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:30.433027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a1458-f645-45d1-8f98-dc2afe468a78 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:30.437773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b07e3-a92c-4401-9b6e-219784747de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:30.438443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b07e3-a92c-4401-9b6e-219784747de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:30.438759 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b07e3-a92c-4401-9b6e-219784747de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:30.439056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b07e3-a92c-4401-9b6e-219784747de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:30.439792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b07e3-a92c-4401-9b6e-219784747de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:30.441431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b07e3-a92c-4401-9b6e-219784747de5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:30.452439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1302/2555] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:17:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:17:30.456960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c0dbf-18ac-4217-bc60-db78dc6a9350 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:30.468200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c0dbf-18ac-4217-bc60-db78dc6a9350 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:30.483167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:30.487429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:30.487608 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:30.487816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] PATH_INFO: `/v3/projects/cdf01f671098410e85f1a8f567f16e89/users/cd6c8e0b394c479c8ad7e6cfda213c33/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:30.508665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf01f671098410e85f1a8f567f16e89, user_id=cd6c8e0b394c479c8ad7e6cfda213c33, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:30.512061 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:30.592096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1254/2556] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:17:30 2021] PUT /identity/v3/projects/cdf01f671098410e85f1a8f567f16e89/users/cd6c8e0b394c479c8ad7e6cfda213c33/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:17:30.602387 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5d71-2543-4c48-acd2-98d381ee91c6 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:30.602702 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5d71-2543-4c48-acd2-98d381ee91c6 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:30.602980 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5d71-2543-4c48-acd2-98d381ee91c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:30.634353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7efc5d71-2543-4c48-acd2-98d381ee91c6 None None] MFA Rules not processed for user `cd6c8e0b394c479c8ad7e6cfda213c33`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:30.637801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7efc5d71-2543-4c48-acd2-98d381ee91c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:30.734142 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1303/2557] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:30.742578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:30.746358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:30.862710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64c8ee-5f4c-4850-9ecb-c570a7ec2672 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:30.866588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e74b2-0be5-4440-b635-0d47d3897b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:30.867242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e74b2-0be5-4440-b635-0d47d3897b66 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:30.867522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e74b2-0be5-4440-b635-0d47d3897b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:30.867789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e74b2-0be5-4440-b635-0d47d3897b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:30.880951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e74b2-0be5-4440-b635-0d47d3897b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:30.882468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e74b2-0be5-4440-b635-0d47d3897b66 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:30.892667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1255/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:17:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:17:38.166105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc5d71-2543-4c48-acd2-98d381ee91c6 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:38.167632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7efc5d71-2543-4c48-acd2-98d381ee91c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:38.226384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc5d71-2543-4c48-acd2-98d381ee91c6 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:38.230770 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f81c91-796c-4392-815f-ceb8ad4cf4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:38.231428 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f81c91-796c-4392-815f-ceb8ad4cf4dc service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:38.231704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f81c91-796c-4392-815f-ceb8ad4cf4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:38.231982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f81c91-796c-4392-815f-ceb8ad4cf4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:38.233812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-75f81c91-796c-4392-815f-ceb8ad4cf4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:38.297620 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f81c91-796c-4392-815f-ceb8ad4cf4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:38.299094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f81c91-796c-4392-815f-ceb8ad4cf4dc service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:38.309559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1304/2559] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:17:38 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:17:43.272931 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e74b2-0be5-4440-b635-0d47d3897b66 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:43.340509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e74b2-0be5-4440-b635-0d47d3897b66 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:43.344668 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:43.345537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:43.345814 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:43.346088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] PATH_INFO: `/v3/users/cd6c8e0b394c479c8ad7e6cfda213c33` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:43.347297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6c8e0b394c479c8ad7e6cfda213c33)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:43.349206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:43.540581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6c8e0b394c479c8ad7e6cfda213c33'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:43.541542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6c8e0b394c479c8ad7e6cfda213c33'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:43.542514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6c8e0b394c479c8ad7e6cfda213c33'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:43.631209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6c8e0b394c479c8ad7e6cfda213c33'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:43.646257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6c8e0b394c479c8ad7e6cfda213c33'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:43.660074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1256/2560] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:17:43 2021] DELETE /identity/v3/users/cd6c8e0b394c479c8ad7e6cfda213c33 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:43.664668 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480062-500d-437d-a8ff-24879841779f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:43.665465 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480062-500d-437d-a8ff-24879841779f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:43.665465 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5480062-500d-437d-a8ff-24879841779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:43.683128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a5480062-500d-437d-a8ff-24879841779f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:43.684345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a5480062-500d-437d-a8ff-24879841779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:43.745612 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1305/2561] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:43.755702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:43.761578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:43.817505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258ed9e-572b-4e9b-8fe4-d1814c1ee9dd admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:43.824958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:43.824958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:43.824958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:43.825674 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:43.839190 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:43.842056 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:43.857979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1257/2562] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:17:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:17:44.146464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5480062-500d-437d-a8ff-24879841779f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:44.150159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a5480062-500d-437d-a8ff-24879841779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:44.168191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5480062-500d-437d-a8ff-24879841779f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:44.173089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:44.174002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:44.175786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:44.175786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] PATH_INFO: `/v3/users/66f23603f3d64e40b27051004102a506` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:44.175786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f23603f3d64e40b27051004102a506)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:44.177942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:44.364924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:44.367391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:44.374253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f23603f3d64e40b27051004102a506'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.374973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f23603f3d64e40b27051004102a506'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.375525 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f23603f3d64e40b27051004102a506'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.388666 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b57ea-e002-4961-ae8d-fc0486df9487 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:44.394452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:44.395439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:44.399647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:44.399647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] PATH_INFO: `/v3/projects/cdf01f671098410e85f1a8f567f16e89` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:44.399647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf01f671098410e85f1a8f567f16e89)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:44.399647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:44.448355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f23603f3d64e40b27051004102a506'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.460916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-2df59261-3fcd-4b1a-aad5-9638c3aa5dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f23603f3d64e40b27051004102a506'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.473087 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1306/2563] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:17:44 2021] DELETE /identity/v3/users/66f23603f3d64e40b27051004102a506 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:44.478499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da243ce6-0aac-4a74-92de-f50877ab2fc2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:44.478837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da243ce6-0aac-4a74-92de-f50877ab2fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:44.479083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da243ce6-0aac-4a74-92de-f50877ab2fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:44.498109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-da243ce6-0aac-4a74-92de-f50877ab2fc2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:44.499371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-da243ce6-0aac-4a74-92de-f50877ab2fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:44.527964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf01f671098410e85f1a8f567f16e89', 'request_id': 'req-89fb5ddd-130b-4702-924d-e891f6b63684'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.568909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1307/2564] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:17:44.579758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da243ce6-0aac-4a74-92de-f50877ab2fc2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:44.581183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-da243ce6-0aac-4a74-92de-f50877ab2fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:44.597062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf01f671098410e85f1a8f567f16e89', 'request_id': 'req-89fb5ddd-130b-4702-924d-e891f6b63684'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.604924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf01f671098410e85f1a8f567f16e89', 'request_id': 'req-89fb5ddd-130b-4702-924d-e891f6b63684'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.617774 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] The token cache is being invalidate because project cdf01f671098410e85f1a8f567f16e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:17:44.620411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.620886 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:44.623414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1258/2565] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:17:44 2021] DELETE /identity/v3/projects/cdf01f671098410e85f1a8f567f16e89 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:44.656741 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da243ce6-0aac-4a74-92de-f50877ab2fc2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:44.737293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:44.738018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:44.738244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:44.738520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:44.740733 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:44.816829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:44.818329 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:44.829226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1308/2566] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:17:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:17:45.261912 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:45.268488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:45.287224 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5ddd-130b-4702-924d-e891f6b63684 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:45.295749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:45.297036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:45.300723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:45.300723 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] PATH_INFO: `/v3/projects/5f1a88e4d3cf4640b92be771996d949e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:45.301838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1a88e4d3cf4640b92be771996d949e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:45.304696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:45.454483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1a88e4d3cf4640b92be771996d949e', 'request_id': 'req-bf9d6419-8a35-4c01-b228-49a153420a18'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:45.527508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1a88e4d3cf4640b92be771996d949e', 'request_id': 'req-bf9d6419-8a35-4c01-b228-49a153420a18'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:45.533906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1a88e4d3cf4640b92be771996d949e', 'request_id': 'req-bf9d6419-8a35-4c01-b228-49a153420a18'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:45.547531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] The token cache is being invalidate because project 5f1a88e4d3cf4640b92be771996d949e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:17:45.547824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:45.548521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:45.550102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1259/2567] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:17:45 2021] DELETE /identity/v3/projects/5f1a88e4d3cf4640b92be771996d949e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:55.626258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:55.627760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:55.643244 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e46b-642f-44d9-aa0e-d5d59d1a8ecc service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:55.704047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:55.704881 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:55.705212 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:55.705544 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] PATH_INFO: `/v3/users/55ae75b130bf4a38a81d48b87c14a464` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:55.706961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ae75b130bf4a38a81d48b87c14a464)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:55.709141 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:55.911325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ae75b130bf4a38a81d48b87c14a464'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:55.911970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ae75b130bf4a38a81d48b87c14a464'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:55.912569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ae75b130bf4a38a81d48b87c14a464'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:55.983886 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ae75b130bf4a38a81d48b87c14a464'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:55.997372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-df1e02c7-04f3-4390-93c1-57c18aa44d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ae75b130bf4a38a81d48b87c14a464'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:56.010399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1309/2568] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:17:55 2021] DELETE /identity/v3/users/55ae75b130bf4a38a81d48b87c14a464 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:56.289645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:56.289645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:56.318521 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d6419-8a35-4c01-b228-49a153420a18 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:56.393221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:56.394688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:56.395149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:56.395603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] PATH_INFO: `/v3/projects/ed26d137d98846b9b45708f7e581e9b0` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:56.397702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed26d137d98846b9b45708f7e581e9b0)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:56.401153 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:56.546471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed26d137d98846b9b45708f7e581e9b0', 'request_id': 'req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:56.631551 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed26d137d98846b9b45708f7e581e9b0', 'request_id': 'req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:56.641746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed26d137d98846b9b45708f7e581e9b0', 'request_id': 'req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:56.661958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] The token cache is being invalidate because project ed26d137d98846b9b45708f7e581e9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:17:56.662360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:56.663097 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-bf21ccad-8952-4dbb-a4b8-eb057ae931b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:17:56.666220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1260/2569] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:17:56 2021] DELETE /identity/v3/projects/ed26d137d98846b9b45708f7e581e9b0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:56.672177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4055f9-9861-4846-a180-3d0626ba60f4 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:56.672801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4055f9-9861-4846-a180-3d0626ba60f4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:56.672801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4055f9-9861-4846-a180-3d0626ba60f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:56.693951 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ce4055f9-9861-4846-a180-3d0626ba60f4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:56.695193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ce4055f9-9861-4846-a180-3d0626ba60f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:56.768225 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1310/2570] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:56.777482 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd52c0-a91f-4dd6-9ad2-fdaf35bdb9b0 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:56.777767 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd52c0-a91f-4dd6-9ad2-fdaf35bdb9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:56.778041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd52c0-a91f-4dd6-9ad2-fdaf35bdb9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:56.797200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7dbd52c0-a91f-4dd6-9ad2-fdaf35bdb9b0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:56.798335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7dbd52c0-a91f-4dd6-9ad2-fdaf35bdb9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:56.806438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1261/2571] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:17:56.811218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4055f9-9861-4846-a180-3d0626ba60f4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:56.821186 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4055f9-9861-4846-a180-3d0626ba60f4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:56.825804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:56.826456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:56.826880 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:56.827163 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:56.827895 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:17:56.828199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:56.829919 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:56.842594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1311/2572] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:17:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:17:56.848234 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd52c0-a91f-4dd6-9ad2-fdaf35bdb9b0 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:56.858489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd52c0-a91f-4dd6-9ad2-fdaf35bdb9b0 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:56.863329 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f81db0-aa6d-4452-9a44-6f4ba1d94ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:56.863979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f81db0-aa6d-4452-9a44-6f4ba1d94ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:56.864261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f81db0-aa6d-4452-9a44-6f4ba1d94ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:56.864542 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f81db0-aa6d-4452-9a44-6f4ba1d94ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:56.865252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f81db0-aa6d-4452-9a44-6f4ba1d94ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:56.867187 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f81db0-aa6d-4452-9a44-6f4ba1d94ec4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:56.982356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1262/2573] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:17:56 2021] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:17:56.986969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:56.997937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7da53-40e8-438a-abb2-fd640ef29c41 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:57.057456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef356d4-6d80-4663-82c6-804ace3be86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:57.057456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef356d4-6d80-4663-82c6-804ace3be86f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:57.057843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef356d4-6d80-4663-82c6-804ace3be86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:57.057971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef356d4-6d80-4663-82c6-804ace3be86f admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:57.058644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef356d4-6d80-4663-82c6-804ace3be86f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:57.060645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef356d4-6d80-4663-82c6-804ace3be86f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:57.163756 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1312/2574] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:17:56 2021] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:17:57.168688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f81db0-aa6d-4452-9a44-6f4ba1d94ec4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:57.180075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f81db0-aa6d-4452-9a44-6f4ba1d94ec4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:57.185088 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe986-26de-4e32-8121-311c2a54a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:57.185780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe986-26de-4e32-8121-311c2a54a847 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:57.186060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe986-26de-4e32-8121-311c2a54a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:57.186362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe986-26de-4e32-8121-311c2a54a847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:57.187154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fe986-26de-4e32-8121-311c2a54a847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:57.188787 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fe986-26de-4e32-8121-311c2a54a847 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:57.200691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1263/2575] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:17:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:17:57.205325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef356d4-6d80-4663-82c6-804ace3be86f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:57.217154 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef356d4-6d80-4663-82c6-804ace3be86f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:57.223414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f70d3d-07c6-4ff6-be41-73e5755da6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:57.224110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70d3d-07c6-4ff6-be41-73e5755da6be admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:57.224390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70d3d-07c6-4ff6-be41-73e5755da6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:57.224667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70d3d-07c6-4ff6-be41-73e5755da6be admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:57.225677 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f70d3d-07c6-4ff6-be41-73e5755da6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:57.227588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f70d3d-07c6-4ff6-be41-73e5755da6be admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:57.238956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1313/2576] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:17:57 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:17:57.243607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe986-26de-4e32-8121-311c2a54a847 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:57.256474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe986-26de-4e32-8121-311c2a54a847 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:57.263930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:57.265298 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:57.265660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:57.265935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] PATH_INFO: `/v3/projects/7e951c2eae284261a98b317ec84140db/users/92909ef457b1401ca5c19d3c863af63e/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:57.284528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e951c2eae284261a98b317ec84140db, user_id=92909ef457b1401ca5c19d3c863af63e, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:57.287594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:57.379848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1264/2577] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:17:57 2021] PUT /identity/v3/projects/7e951c2eae284261a98b317ec84140db/users/92909ef457b1401ca5c19d3c863af63e/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:17:57.385789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8169-60ca-491f-8d45-2a17b725e5fc None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:57.386078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8169-60ca-491f-8d45-2a17b725e5fc None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:57.386361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8169-60ca-491f-8d45-2a17b725e5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:57.404779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4bff8169-60ca-491f-8d45-2a17b725e5fc None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:17:57.405991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4bff8169-60ca-491f-8d45-2a17b725e5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:57.469905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1314/2578] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:17:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:17:57.480162 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:17:57.481951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:17:57.542707 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed244ee-ac1c-4574-a127-e6de225cdc5e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:17:57.547169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75732ef5-e921-47a7-b6d3-956701139844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:17:57.547825 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ef5-e921-47a7-b6d3-956701139844 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:17:57.548107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ef5-e921-47a7-b6d3-956701139844 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:17:57.548382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ef5-e921-47a7-b6d3-956701139844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:17:57.558670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75732ef5-e921-47a7-b6d3-956701139844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:17:57.559973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75732ef5-e921-47a7-b6d3-956701139844 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:17:57.569660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1265/2579] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:17:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:18:02.345609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741f80-1952-42db-899e-70ffa66b3111 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:18:02.346479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741f80-1952-42db-899e-70ffa66b3111 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:18:02.346479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741f80-1952-42db-899e-70ffa66b3111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:18:02.399545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-08741f80-1952-42db-899e-70ffa66b3111 None None] MFA Rules not processed for user `16dc67eb7c164a2fb9ce650c032e1340`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:18:02.401847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-08741f80-1952-42db-899e-70ffa66b3111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:18:02.484496 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1315/2580] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:18:02 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:18:03.676577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8cdd-e3c6-4f03-aaaa-25662509ddeb None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:18:03.678314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8cdd-e3c6-4f03-aaaa-25662509ddeb None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:18:03.678848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe8cdd-e3c6-4f03-aaaa-25662509ddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:18:03.738234 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-7ffe8cdd-e3c6-4f03-aaaa-25662509ddeb None None] MFA Rules not processed for user `92909ef457b1401ca5c19d3c863af63e`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:18:03.740770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7ffe8cdd-e3c6-4f03-aaaa-25662509ddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:18:03.845655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1266/2581] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:18:03 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:18:03.861150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741f80-1952-42db-899e-70ffa66b3111 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:18:03.862534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-08741f80-1952-42db-899e-70ffa66b3111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:18:03.948547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741f80-1952-42db-899e-70ffa66b3111 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:18:03.955812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4360c-cc40-4f85-976e-262a56fd27db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:18:03.956479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4360c-cc40-4f85-976e-262a56fd27db service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:18:03.956763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4360c-cc40-4f85-976e-262a56fd27db service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:18:03.957053 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4360c-cc40-4f85-976e-262a56fd27db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:18:03.965553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4360c-cc40-4f85-976e-262a56fd27db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:18:03.967241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4360c-cc40-4f85-976e-262a56fd27db service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:18:03.977636 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1316/2582] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:18:03 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:18:08.291784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b151-f26a-40af-be90-fa3e77df771f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:18:08.309775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b151-f26a-40af-be90-fa3e77df771f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:18:08.309775 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8b151-f26a-40af-be90-fa3e77df771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:18:08.314742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-65a8b151-f26a-40af-be90-fa3e77df771f None None] MFA Rules not processed for user `92909ef457b1401ca5c19d3c863af63e`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:18:08.316108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-65a8b151-f26a-40af-be90-fa3e77df771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:18:08.324958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1267/2583] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:18:08 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:18:22.855644 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879618f-6eac-464f-a87a-b40bd97c56be None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:18:22.857150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879618f-6eac-464f-a87a-b40bd97c56be None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:18:22.857150 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879618f-6eac-464f-a87a-b40bd97c56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:18:22.878850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a879618f-6eac-464f-a87a-b40bd97c56be None None] MFA Rules not processed for user `cce6286edfa545718b20566887102f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:18:22.880395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a879618f-6eac-464f-a87a-b40bd97c56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:18:22.939399 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1317/2584] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:18:22 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:19:10.502650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8b151-f26a-40af-be90-fa3e77df771f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:10.504532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-65a8b151-f26a-40af-be90-fa3e77df771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:10.519443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8b151-f26a-40af-be90-fa3e77df771f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:10.524633 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:10.525648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:10.525934 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:10.526215 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] PATH_INFO: `/v3/users/16dc67eb7c164a2fb9ce650c032e1340` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:10.527519 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dc67eb7c164a2fb9ce650c032e1340)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:10.529435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:10.695392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dc67eb7c164a2fb9ce650c032e1340'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:10.696089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dc67eb7c164a2fb9ce650c032e1340'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:10.696675 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dc67eb7c164a2fb9ce650c032e1340'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:10.770028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dc67eb7c164a2fb9ce650c032e1340'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:10.782846 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dc67eb7c164a2fb9ce650c032e1340'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:10.794710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1268/2585] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:19:10 2021] DELETE /identity/v3/users/16dc67eb7c164a2fb9ce650c032e1340 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:19:11.023138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879618f-6eac-464f-a87a-b40bd97c56be None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:11.041934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879618f-6eac-464f-a87a-b40bd97c56be None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:11.097966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:11.098853 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:11.099127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:11.099443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] PATH_INFO: `/v3/projects/1b90b3d6739f4eef8dc3f2a78bb8a043` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:11.100594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b90b3d6739f4eef8dc3f2a78bb8a043)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:11.102524 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:11.198345 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b90b3d6739f4eef8dc3f2a78bb8a043', 'request_id': 'req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:11.261258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b90b3d6739f4eef8dc3f2a78bb8a043', 'request_id': 'req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:11.267268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b90b3d6739f4eef8dc3f2a78bb8a043', 'request_id': 'req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:11.279379 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] The token cache is being invalidate because project 1b90b3d6739f4eef8dc3f2a78bb8a043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:19:11.279667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:11.280307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:19:11.281827 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1318/2586] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:19:11 2021] DELETE /identity/v3/projects/1b90b3d6739f4eef8dc3f2a78bb8a043 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:19:15.386616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:15.388141 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:15.450641 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227be0e8-3b8b-46fd-8232-1b66d91ea7d6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:15.500220 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:15.500750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:15.501027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:15.501300 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:15.503166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:15.570950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:15.572384 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:15.583324 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1269/2587] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:19:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:19:21.611055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:21.612539 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:21.628963 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7a61-ad71-4a52-a5a3-971b0dd338cd admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:21.635432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:21.636074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:21.636359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:21.636695 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:21.638489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:21.695667 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:21.697259 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:21.706742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1319/2588] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:19:21 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:19:24.022753 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:24.024213 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:24.084126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ca572-67b9-4e9c-bc2f-2a383a8bc21c service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:24.087749 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:24.088397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:24.088679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:24.088953 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:24.090932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:24.105484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:24.106966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:24.118678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1270/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:19:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:19:41.160700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:41.161957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:41.173623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df846dd-cbf9-4c9c-bb82-985eb8ecf86c service nova] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:41.177931 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c08ac-ec89-4e27-9cf1-4bbc58a26610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:41.178611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c08ac-ec89-4e27-9cf1-4bbc58a26610 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:41.178898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c08ac-ec89-4e27-9cf1-4bbc58a26610 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:41.179199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c08ac-ec89-4e27-9cf1-4bbc58a26610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:41.181027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b90c08ac-ec89-4e27-9cf1-4bbc58a26610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:41.191080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c08ac-ec89-4e27-9cf1-4bbc58a26610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:41.193055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c08ac-ec89-4e27-9cf1-4bbc58a26610 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:41.201084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1320/2590] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:19:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:19:49.408358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:49.419932 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7db74-76bf-4cf7-8edc-b103848977f7 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:49.425412 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:49.426083 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:49.426358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:49.426659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:49.428434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:49.442572 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:49.444413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:49.458504 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1271/2591] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:19:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:19:51.282883 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743d4d-4ccf-4e12-bb83-cd60c5b94f13 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:51.283406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743d4d-4ccf-4e12-bb83-cd60c5b94f13 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:51.283511 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743d4d-4ccf-4e12-bb83-cd60c5b94f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:51.300638 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-50743d4d-4ccf-4e12-bb83-cd60c5b94f13 None None] MFA Rules not processed for user `97c82e393b164313ad7a95eca6b65c26`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:19:51.301817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-50743d4d-4ccf-4e12-bb83-cd60c5b94f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:51.354338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1321/2592] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:19:51 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:19:51.664806 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:51.673906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515a8d-0eed-451d-be72-8ee5f0a6a15a service nova] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:51.677375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:51.677998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:51.678275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:51.678573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:51.680363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:51.689967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:51.691950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:51.699817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1272/2593] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:19:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:19:52.450713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743d4d-4ccf-4e12-bb83-cd60c5b94f13 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:19:52.452232 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-50743d4d-4ccf-4e12-bb83-cd60c5b94f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:52.521750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743d4d-4ccf-4e12-bb83-cd60c5b94f13 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:19:52.526840 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db055fddc41c4eb0ba1c3b410e1e8e03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:19:52.527497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:19:52.527769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:19:52.528046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:19:52.529824 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:19:52.542210 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:19:52.543868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:19:52.555635 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1322/2594] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:19:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:20:06.925690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:20:06.927304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:20:06.944269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1cba-172f-4a41-b15a-2d0109a3c9e7 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:20:06.950269 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ac897-62f9-425b-bcaf-0ec7d6ad1893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:20:06.950949 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ac897-62f9-425b-bcaf-0ec7d6ad1893 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:20:06.951264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ac897-62f9-425b-bcaf-0ec7d6ad1893 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:20:06.951544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ac897-62f9-425b-bcaf-0ec7d6ad1893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:20:06.953339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8b1ac897-62f9-425b-bcaf-0ec7d6ad1893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:20:06.966864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ac897-62f9-425b-bcaf-0ec7d6ad1893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:20:06.968374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ac897-62f9-425b-bcaf-0ec7d6ad1893 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:20:06.979670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1273/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:20:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:20:11.064001 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:20:11.077307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88b4d-0627-4cb7-9eb1-910bd9e3bc04 service placement] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:20:11.083228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:20:11.083882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:20:11.084217 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:20:11.084501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:20:11.086386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:20:11.099670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:20:11.101279 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:20:11.113734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1323/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:20:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:20:15.625601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a051-d3e8-4e20-9fa5-e12b1734aedf None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:20:15.626179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a051-d3e8-4e20-9fa5-e12b1734aedf None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:20:15.626179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688a051-d3e8-4e20-9fa5-e12b1734aedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:20:15.644907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-5688a051-d3e8-4e20-9fa5-e12b1734aedf None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:20:15.646111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-5688a051-d3e8-4e20-9fa5-e12b1734aedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:20:15.699463 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1274/2597] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:20:15 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:20:15.811299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:20:15.812745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:20:15.880757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf8b9a-d5a8-4700-8c9f-ecb603ad47ca service nova] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:20:15.885730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dbb01-c500-46c0-be8a-90ada372987d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:20:15.886381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dbb01-c500-46c0-be8a-90ada372987d service swift] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:20:15.886708 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dbb01-c500-46c0-be8a-90ada372987d service swift] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:20:15.886979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dbb01-c500-46c0-be8a-90ada372987d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:20:15.896432 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dbb01-c500-46c0-be8a-90ada372987d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:20:15.898038 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dbb01-c500-46c0-be8a-90ada372987d service swift] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:20:15.906512 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1324/2598] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:20:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:20:35.388306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60ac9-1501-417d-a07e-b26e04b142ef None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:20:35.388909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60ac9-1501-417d-a07e-b26e04b142ef None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:20:35.388909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60ac9-1501-417d-a07e-b26e04b142ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:20:35.407280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-06f60ac9-1501-417d-a07e-b26e04b142ef None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:20:35.408984 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-06f60ac9-1501-417d-a07e-b26e04b142ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:20:35.416263 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1275/2599] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:20:35 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:20:35.429779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dbb01-c500-46c0-be8a-90ada372987d service swift] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:20:35.441975 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dbb01-c500-46c0-be8a-90ada372987d service swift] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:20:35.447137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029f052-982c-45a4-8276-9d07d09c6361 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:20:35.447807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f052-982c-45a4-8276-9d07d09c6361 service swift] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:20:35.448088 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f052-982c-45a4-8276-9d07d09c6361 service swift] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:20:35.448364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029f052-982c-45a4-8276-9d07d09c6361 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:20:35.457771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029f052-982c-45a4-8276-9d07d09c6361 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:20:35.459436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029f052-982c-45a4-8276-9d07d09c6361 service swift] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:20:35.468896 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1325/2600] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:20:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:20:52.606891 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381be93-2061-402a-b2ec-837304e3e47e None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:20:52.607453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381be93-2061-402a-b2ec-837304e3e47e None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:20:52.607453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381be93-2061-402a-b2ec-837304e3e47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:20:52.624763 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-0381be93-2061-402a-b2ec-837304e3e47e None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:20:52.625944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0381be93-2061-402a-b2ec-837304e3e47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:20:52.633700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1276/2601] 10.222.0.16 () {58 vars in 967 bytes} [Thu Nov 11 17:20:52 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:20:52.648920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029f052-982c-45a4-8276-9d07d09c6361 service swift] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:20:52.659557 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029f052-982c-45a4-8276-9d07d09c6361 service swift] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:20:52.664758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a54b2-0b1f-4ead-9289-1373ec5f265d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:20:52.665390 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a54b2-0b1f-4ead-9289-1373ec5f265d service swift] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:20:52.665672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a54b2-0b1f-4ead-9289-1373ec5f265d service swift] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:20:52.666113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a54b2-0b1f-4ead-9289-1373ec5f265d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:20:52.674289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a54b2-0b1f-4ead-9289-1373ec5f265d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:20:52.675909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a54b2-0b1f-4ead-9289-1373ec5f265d service swift] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:20:52.685456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1326/2602] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:20:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:21:35.473831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee0645-50ee-44f1-bb8b-3ba22de952c2 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:35.474363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee0645-50ee-44f1-bb8b-3ba22de952c2 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:35.474363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee0645-50ee-44f1-bb8b-3ba22de952c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:35.493132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-eaee0645-50ee-44f1-bb8b-3ba22de952c2 None None] MFA Rules not processed for user `92909ef457b1401ca5c19d3c863af63e`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:21:35.494338 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-eaee0645-50ee-44f1-bb8b-3ba22de952c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:35.547020 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1277/2603] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:21:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:21:36.450943 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a54b2-0b1f-4ead-9289-1373ec5f265d service swift] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:36.460656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a54b2-0b1f-4ead-9289-1373ec5f265d service swift] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:36.464231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:36.464855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:36.465131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:36.465655 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:36.467431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:36.533464 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:36.536208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:36.546466 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1327/2604] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:21:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:21:40.953445 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee0645-50ee-44f1-bb8b-3ba22de952c2 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:40.957182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-eaee0645-50ee-44f1-bb8b-3ba22de952c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:40.989423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee0645-50ee-44f1-bb8b-3ba22de952c2 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:40.994917 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:40.995805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:40.996082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:40.996353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] PATH_INFO: `/v3/users/cce6286edfa545718b20566887102f3e` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:41.001740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce6286edfa545718b20566887102f3e)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:41.004860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:41.205462 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce6286edfa545718b20566887102f3e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.206494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce6286edfa545718b20566887102f3e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.207209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce6286edfa545718b20566887102f3e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.282270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce6286edfa545718b20566887102f3e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.296556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce6286edfa545718b20566887102f3e'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.311935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1278/2605] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:21:40 2021] DELETE /identity/v3/users/cce6286edfa545718b20566887102f3e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:21:41.419092 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:41.420839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:41.434757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dcbcd-aeb3-402e-ab30-7b3655458772 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:41.494200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183cb93-a572-4214-a8cb-776849a144bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:41.495170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183cb93-a572-4214-a8cb-776849a144bf service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:41.495639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183cb93-a572-4214-a8cb-776849a144bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:41.495905 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183cb93-a572-4214-a8cb-776849a144bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:41.497916 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a183cb93-a572-4214-a8cb-776849a144bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:41.569077 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183cb93-a572-4214-a8cb-776849a144bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:41.570982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183cb93-a572-4214-a8cb-776849a144bf service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:41.581472 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1328/2606] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:21:41 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:21:41.586647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:41.591027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:41.672364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeee13-3756-4871-af72-748ed1cfdf4c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:41.677883 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:41.678864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:41.679204 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:41.679547 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] PATH_INFO: `/v3/projects/3a6e5bdc578b460ab28a883efa598f95` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:41.680884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6e5bdc578b460ab28a883efa598f95)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:41.682908 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:41.798185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6e5bdc578b460ab28a883efa598f95', 'request_id': 'req-2b5a1c08-6757-4fab-a75a-c92a5622c142'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.892680 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6e5bdc578b460ab28a883efa598f95', 'request_id': 'req-2b5a1c08-6757-4fab-a75a-c92a5622c142'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.898832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6e5bdc578b460ab28a883efa598f95', 'request_id': 'req-2b5a1c08-6757-4fab-a75a-c92a5622c142'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.910535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] The token cache is being invalidate because project 3a6e5bdc578b460ab28a883efa598f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:21:41.910856 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.911495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b5a1c08-6757-4fab-a75a-c92a5622c142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:21:41.913029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1279/2607] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:21:41 2021] DELETE /identity/v3/projects/3a6e5bdc578b460ab28a883efa598f95 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:21:41.919059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e04a5-fd1c-422b-a4fa-6f646f8b3dd2 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:41.919353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e04a5-fd1c-422b-a4fa-6f646f8b3dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:41.919639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e04a5-fd1c-422b-a4fa-6f646f8b3dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:41.940189 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-487e04a5-fd1c-422b-a4fa-6f646f8b3dd2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:21:41.941474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-487e04a5-fd1c-422b-a4fa-6f646f8b3dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:42.002355 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1329/2608] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:21:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:21:42.011119 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a99a9d-a022-4f6b-b1e9-cb8fc1e6e1b6 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.011638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a99a9d-a022-4f6b-b1e9-cb8fc1e6e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.011951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a99a9d-a022-4f6b-b1e9-cb8fc1e6e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.029949 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-f1a99a9d-a022-4f6b-b1e9-cb8fc1e6e1b6 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:21:42.031182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f1a99a9d-a022-4f6b-b1e9-cb8fc1e6e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:42.039907 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1280/2609] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:21:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:21:42.044237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e04a5-fd1c-422b-a4fa-6f646f8b3dd2 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:42.054949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e04a5-fd1c-422b-a4fa-6f646f8b3dd2 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:42.060057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:42.067953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.067953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.067953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.067953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:21:42.067953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:42.067953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:42.079300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1330/2610] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:21:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:21:42.082111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a99a9d-a022-4f6b-b1e9-cb8fc1e6e1b6 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:42.094060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a99a9d-a022-4f6b-b1e9-cb8fc1e6e1b6 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:42.100928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b86f-34b6-4ad5-89c3-7bc5a9e010d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:42.101606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b86f-34b6-4ad5-89c3-7bc5a9e010d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.101885 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b86f-34b6-4ad5-89c3-7bc5a9e010d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.102776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b86f-34b6-4ad5-89c3-7bc5a9e010d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.103042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120b86f-34b6-4ad5-89c3-7bc5a9e010d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:42.105989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120b86f-34b6-4ad5-89c3-7bc5a9e010d5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:42.239434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1281/2611] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:21:42 2021] POST /identity/v3/projects => generated 355 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:21:42.243732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:42.254030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51e6e7-e58d-4ab8-946d-1058495f6624 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:42.309069 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061bfa9-2ee9-4562-b1c4-1820ede6db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:42.309734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061bfa9-2ee9-4562-b1c4-1820ede6db2f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.310011 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061bfa9-2ee9-4562-b1c4-1820ede6db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.310278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061bfa9-2ee9-4562-b1c4-1820ede6db2f admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.311027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061bfa9-2ee9-4562-b1c4-1820ede6db2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:42.312929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061bfa9-2ee9-4562-b1c4-1820ede6db2f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:42.453400 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1331/2612] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:21:42 2021] POST /identity/v3/users => generated 278 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:21:42.455344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b86f-34b6-4ad5-89c3-7bc5a9e010d5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:42.470497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b86f-34b6-4ad5-89c3-7bc5a9e010d5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:42.479010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3ce6-9b80-40b9-a470-fac8664685b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:42.479698 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3ce6-9b80-40b9-a470-fac8664685b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.479998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3ce6-9b80-40b9-a470-fac8664685b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.480271 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3ce6-9b80-40b9-a470-fac8664685b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.481012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3ce6-9b80-40b9-a470-fac8664685b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:42.482711 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3ce6-9b80-40b9-a470-fac8664685b5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:42.492963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1282/2613] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:21:42 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:21:42.497052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061bfa9-2ee9-4562-b1c4-1820ede6db2f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:42.507506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061bfa9-2ee9-4562-b1c4-1820ede6db2f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:42.512293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755deab-480d-4bea-b587-20c6bf5e9ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:42.513320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755deab-480d-4bea-b587-20c6bf5e9ded admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.513320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755deab-480d-4bea-b587-20c6bf5e9ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.513502 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755deab-480d-4bea-b587-20c6bf5e9ded admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.514226 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755deab-480d-4bea-b587-20c6bf5e9ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:42.516075 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755deab-480d-4bea-b587-20c6bf5e9ded admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:42.527043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1332/2614] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:21:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:21:42.531231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3ce6-9b80-40b9-a470-fac8664685b5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:42.541871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3ce6-9b80-40b9-a470-fac8664685b5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:42.546561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f318dd-0ace-4e28-a117-3dd3d8ac8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:42.547453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f318dd-0ace-4e28-a117-3dd3d8ac8e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.547736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f318dd-0ace-4e28-a117-3dd3d8ac8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.548013 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f318dd-0ace-4e28-a117-3dd3d8ac8e5b admin admin] PATH_INFO: `/v3/projects/0374b08818314b12966b41af2bf47650/users/f06c3a4189894296aa47a62a052fd88f/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.562595 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f318dd-0ace-4e28-a117-3dd3d8ac8e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0374b08818314b12966b41af2bf47650, user_id=f06c3a4189894296aa47a62a052fd88f, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:42.565771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f318dd-0ace-4e28-a117-3dd3d8ac8e5b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:42.636431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1283/2615] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:21:42 2021] PUT /identity/v3/projects/0374b08818314b12966b41af2bf47650/users/f06c3a4189894296aa47a62a052fd88f/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:21:42.647193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa4b6f-8246-4c07-928b-d37e9834b725 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.647481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa4b6f-8246-4c07-928b-d37e9834b725 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.647757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa4b6f-8246-4c07-928b-d37e9834b725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.674829 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-31aa4b6f-8246-4c07-928b-d37e9834b725 None None] MFA Rules not processed for user `f06c3a4189894296aa47a62a052fd88f`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:21:42.676049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-31aa4b6f-8246-4c07-928b-d37e9834b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:42.748113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1333/2616] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:21:42 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:21:42.753291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f318dd-0ace-4e28-a117-3dd3d8ac8e5b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:42.817495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f318dd-0ace-4e28-a117-3dd3d8ac8e5b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:42.822409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6deb772-289e-4888-bb78-0632bbd9ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:42.823087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deb772-289e-4888-bb78-0632bbd9ac0c admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.823364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deb772-289e-4888-bb78-0632bbd9ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.823634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deb772-289e-4888-bb78-0632bbd9ac0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.824326 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6deb772-289e-4888-bb78-0632bbd9ac0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:42.826209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6deb772-289e-4888-bb78-0632bbd9ac0c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:42.901323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1284/2617] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:21:42 2021] POST /identity/v3/projects => generated 355 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:21:42.904543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa4b6f-8246-4c07-928b-d37e9834b725 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:42.915330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa4b6f-8246-4c07-928b-d37e9834b725 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:42.969889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eda20-c893-4d1e-bdff-ed773cf74652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:42.970561 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eda20-c893-4d1e-bdff-ed773cf74652 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:42.970852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eda20-c893-4d1e-bdff-ed773cf74652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:42.971127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eda20-c893-4d1e-bdff-ed773cf74652 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:42.971850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eda20-c893-4d1e-bdff-ed773cf74652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:42.973742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eda20-c893-4d1e-bdff-ed773cf74652 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:43.059155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1334/2618] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:21:42 2021] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:21:43.063174 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6deb772-289e-4888-bb78-0632bbd9ac0c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:43.073425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6deb772-289e-4888-bb78-0632bbd9ac0c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:43.078460 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e0e74-9e2e-4955-9f8d-fa8eed912b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:43.080038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e0e74-9e2e-4955-9f8d-fa8eed912b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:43.080801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e0e74-9e2e-4955-9f8d-fa8eed912b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:43.081085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e0e74-9e2e-4955-9f8d-fa8eed912b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:43.081833 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e0e74-9e2e-4955-9f8d-fa8eed912b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:43.083544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e0e74-9e2e-4955-9f8d-fa8eed912b91 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:43.094730 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1285/2619] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:21:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:21:43.099783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eda20-c893-4d1e-bdff-ed773cf74652 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:43.110084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eda20-c893-4d1e-bdff-ed773cf74652 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:43.115725 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69978de3-fb42-4fe5-bb01-618b923b4bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:43.116619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978de3-fb42-4fe5-bb01-618b923b4bca admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:43.116907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978de3-fb42-4fe5-bb01-618b923b4bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:43.117162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978de3-fb42-4fe5-bb01-618b923b4bca admin admin] PATH_INFO: `/v3/projects/d7fa2029ff0f4662aaace8d7eeb3d95c/users/782559f6a03c4d5a99b7f6d6d4aa60fa/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:43.132388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69978de3-fb42-4fe5-bb01-618b923b4bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fa2029ff0f4662aaace8d7eeb3d95c, user_id=782559f6a03c4d5a99b7f6d6d4aa60fa, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:43.135199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69978de3-fb42-4fe5-bb01-618b923b4bca admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:43.208169 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1335/2620] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:21:43 2021] PUT /identity/v3/projects/d7fa2029ff0f4662aaace8d7eeb3d95c/users/782559f6a03c4d5a99b7f6d6d4aa60fa/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:21:43.212553 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e0e74-9e2e-4955-9f8d-fa8eed912b91 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:43.223497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e0e74-9e2e-4955-9f8d-fa8eed912b91 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:43.277100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c98401-7035-4281-910c-5667d3fee64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:43.277813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98401-7035-4281-910c-5667d3fee64b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:43.278093 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98401-7035-4281-910c-5667d3fee64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:43.278364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98401-7035-4281-910c-5667d3fee64b admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:43.279129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c98401-7035-4281-910c-5667d3fee64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:43.280778 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c98401-7035-4281-910c-5667d3fee64b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:43.291136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1286/2621] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:21:43 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:21:43.295351 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69978de3-fb42-4fe5-bb01-618b923b4bca admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:43.306595 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69978de3-fb42-4fe5-bb01-618b923b4bca admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:43.311628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:43.312454 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:43.312732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:43.313007 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] PATH_INFO: `/v3/projects/d7fa2029ff0f4662aaace8d7eeb3d95c/users/782559f6a03c4d5a99b7f6d6d4aa60fa/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:43.315545 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fa2029ff0f4662aaace8d7eeb3d95c, user_id=782559f6a03c4d5a99b7f6d6d4aa60fa, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:43.318175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:43.329121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1336/2622] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:21:43 2021] PUT /identity/v3/projects/d7fa2029ff0f4662aaace8d7eeb3d95c/users/782559f6a03c4d5a99b7f6d6d4aa60fa/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:21:43.341318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaedcd5-adac-45ac-a5ad-d06d99181911 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:43.341604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaedcd5-adac-45ac-a5ad-d06d99181911 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:43.341881 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaedcd5-adac-45ac-a5ad-d06d99181911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:43.368261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-ddaedcd5-adac-45ac-a5ad-d06d99181911 None None] MFA Rules not processed for user `782559f6a03c4d5a99b7f6d6d4aa60fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:21:43.369455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ddaedcd5-adac-45ac-a5ad-d06d99181911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:43.442462 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1287/2623] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:21:43 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:21:43.452648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:43.454353 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:43.509782 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03c18-09e1-4c7a-8db5-017ccbd9fed3 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:43.513456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb0804-01eb-4849-b40b-ce5953f62b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:43.514170 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb0804-01eb-4849-b40b-ce5953f62b8b service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:43.514450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb0804-01eb-4849-b40b-ce5953f62b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:43.514771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb0804-01eb-4849-b40b-ce5953f62b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:43.526610 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb0804-01eb-4849-b40b-ce5953f62b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:43.528374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb0804-01eb-4849-b40b-ce5953f62b8b service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:43.538992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1337/2624] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:21:43 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:21:43.762347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaedcd5-adac-45ac-a5ad-d06d99181911 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:21:43.771797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaedcd5-adac-45ac-a5ad-d06d99181911 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:21:43.775291 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858af60-aea0-451e-be60-c8066b9fea4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:21:43.775914 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858af60-aea0-451e-be60-c8066b9fea4e service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:43.778179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858af60-aea0-451e-be60-c8066b9fea4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:43.778179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858af60-aea0-451e-be60-c8066b9fea4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:43.854525 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858af60-aea0-451e-be60-c8066b9fea4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:21:43.856001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858af60-aea0-451e-be60-c8066b9fea4e service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:21:43.865585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1288/2625] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:21:43 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:21:50.349868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096c5e-72a4-4e97-b692-1c4fc3d40131 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:21:50.350427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096c5e-72a4-4e97-b692-1c4fc3d40131 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:21:50.350427 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb096c5e-72a4-4e97-b692-1c4fc3d40131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:21:50.368499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-bb096c5e-72a4-4e97-b692-1c4fc3d40131 None None] MFA Rules not processed for user `97c82e393b164313ad7a95eca6b65c26`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:21:50.371166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bb096c5e-72a4-4e97-b692-1c4fc3d40131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:21:50.428961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1338/2626] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:21:50 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:03.584214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858af60-aea0-451e-be60-c8066b9fea4e service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:03.642957 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858af60-aea0-451e-be60-c8066b9fea4e service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:03.647867 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:03.648717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:03.648993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:03.649260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] PATH_INFO: `/v3/users/f06c3a4189894296aa47a62a052fd88f` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:03.650491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06c3a4189894296aa47a62a052fd88f)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:03.652406 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:03.830284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06c3a4189894296aa47a62a052fd88f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:03.830942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06c3a4189894296aa47a62a052fd88f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:03.832112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06c3a4189894296aa47a62a052fd88f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:03.914509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06c3a4189894296aa47a62a052fd88f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:03.927888 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06c3a4189894296aa47a62a052fd88f'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:03.939635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1289/2627] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:22:03 2021] DELETE /identity/v3/users/f06c3a4189894296aa47a62a052fd88f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:03.945251 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d5b9-9451-4011-9604-2c6e48743a59 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:03.945777 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d5b9-9451-4011-9604-2c6e48743a59 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:03.946263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80d5b9-9451-4011-9604-2c6e48743a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:03.965965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-df80d5b9-9451-4011-9604-2c6e48743a59 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:03.967199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-df80d5b9-9451-4011-9604-2c6e48743a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:04.027949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1339/2628] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:22:04.037703 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:04.039122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:04.092950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ab118-688a-4548-8e33-538d7a27a2f5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:04.096508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b4d8f-de91-4204-b936-79908aa97d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:04.097138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b4d8f-de91-4204-b936-79908aa97d42 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:04.097423 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b4d8f-de91-4204-b936-79908aa97d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:04.097696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b4d8f-de91-4204-b936-79908aa97d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:04.106503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b4d8f-de91-4204-b936-79908aa97d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:04.108039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b4d8f-de91-4204-b936-79908aa97d42 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:04.118642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1290/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:22:04.482949 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80d5b9-9451-4011-9604-2c6e48743a59 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:04.484005 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-df80d5b9-9451-4011-9604-2c6e48743a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:04.496283 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80d5b9-9451-4011-9604-2c6e48743a59 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:04.500899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:04.501766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:04.502048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:04.502323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] PATH_INFO: `/v3/projects/0374b08818314b12966b41af2bf47650` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:04.503531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0374b08818314b12966b41af2bf47650)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:04.505458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:04.652263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0374b08818314b12966b41af2bf47650', 'request_id': 'req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:04.726006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0374b08818314b12966b41af2bf47650', 'request_id': 'req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:04.734692 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0374b08818314b12966b41af2bf47650', 'request_id': 'req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:04.745751 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] The token cache is being invalidate because project 0374b08818314b12966b41af2bf47650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:22:04.746431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:04.746813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:04.748358 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1340/2630] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:22:04 2021] DELETE /identity/v3/projects/0374b08818314b12966b41af2bf47650 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:04.752225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b4d8f-de91-4204-b936-79908aa97d42 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:04.761890 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b4d8f-de91-4204-b936-79908aa97d42 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:04.818496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:04.819399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:04.819683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:04.819955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] PATH_INFO: `/v3/users/782559f6a03c4d5a99b7f6d6d4aa60fa` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:04.821181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=782559f6a03c4d5a99b7f6d6d4aa60fa)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:04.823136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:05.054004 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782559f6a03c4d5a99b7f6d6d4aa60fa'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.054664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782559f6a03c4d5a99b7f6d6d4aa60fa'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.055284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782559f6a03c4d5a99b7f6d6d4aa60fa'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.148864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782559f6a03c4d5a99b7f6d6d4aa60fa'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.162430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-dad32a7b-368c-46e9-9382-bda2b83e3a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782559f6a03c4d5a99b7f6d6d4aa60fa'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.175373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1291/2631] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:22:04 2021] DELETE /identity/v3/users/782559f6a03c4d5a99b7f6d6d4aa60fa => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:05.608646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:05.610289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:05.624772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e47e-ce4f-45c9-8b92-2896cacfc0aa admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:05.711606 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:05.712476 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:05.712933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:05.713211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] PATH_INFO: `/v3/projects/d7fa2029ff0f4662aaace8d7eeb3d95c` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:05.714744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fa2029ff0f4662aaace8d7eeb3d95c)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:05.716672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:05.835933 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fa2029ff0f4662aaace8d7eeb3d95c', 'request_id': 'req-5037cc8e-5a02-42d4-997c-3d309bf62f77'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.897590 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fa2029ff0f4662aaace8d7eeb3d95c', 'request_id': 'req-5037cc8e-5a02-42d4-997c-3d309bf62f77'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.904051 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fa2029ff0f4662aaace8d7eeb3d95c', 'request_id': 'req-5037cc8e-5a02-42d4-997c-3d309bf62f77'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.916806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] The token cache is being invalidate because project d7fa2029ff0f4662aaace8d7eeb3d95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:22:05.917127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.917797 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5037cc8e-5a02-42d4-997c-3d309bf62f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:05.919713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1341/2632] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:22:05 2021] DELETE /identity/v3/projects/d7fa2029ff0f4662aaace8d7eeb3d95c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:22:05.927653 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e289-ab95-4f56-a28e-6ee2ef77f9fc None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:05.928136 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e289-ab95-4f56-a28e-6ee2ef77f9fc None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:05.928489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241e289-ab95-4f56-a28e-6ee2ef77f9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:05.949062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-9241e289-ab95-4f56-a28e-6ee2ef77f9fc None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:05.950243 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-9241e289-ab95-4f56-a28e-6ee2ef77f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:06.006950 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1292/2633] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:06.014812 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aba74c-0fe9-49d6-a174-c8d22c1fcf99 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.015103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aba74c-0fe9-49d6-a174-c8d22c1fcf99 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.015385 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aba74c-0fe9-49d6-a174-c8d22c1fcf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.036115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-a5aba74c-0fe9-49d6-a174-c8d22c1fcf99 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:06.037336 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a5aba74c-0fe9-49d6-a174-c8d22c1fcf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:06.045497 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1342/2634] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:06.049773 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241e289-ab95-4f56-a28e-6ee2ef77f9fc None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:06.059567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241e289-ab95-4f56-a28e-6ee2ef77f9fc None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:06.064301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:06.064971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.065248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.066101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.066878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:22:06.067184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:06.068789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:06.080688 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1293/2635] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:22:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:22:06.085830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aba74c-0fe9-49d6-a174-c8d22c1fcf99 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:06.095197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aba74c-0fe9-49d6-a174-c8d22c1fcf99 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:06.099920 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b45f-4dcc-470f-b0ab-5b0c9f845f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:06.100576 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b45f-4dcc-470f-b0ab-5b0c9f845f46 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.100862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b45f-4dcc-470f-b0ab-5b0c9f845f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.101122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131b45f-4dcc-470f-b0ab-5b0c9f845f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.101830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131b45f-4dcc-470f-b0ab-5b0c9f845f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:06.103746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131b45f-4dcc-470f-b0ab-5b0c9f845f46 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:06.183081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1343/2636] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:22:06 2021] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:22:06.184341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:06.194831 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95331c-7536-406f-8df7-87cc9ff75240 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:06.250342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64908855-0781-493e-badf-1b6f6c09704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:06.251082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64908855-0781-493e-badf-1b6f6c09704b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.251363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64908855-0781-493e-badf-1b6f6c09704b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.251637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64908855-0781-493e-badf-1b6f6c09704b admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.252339 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64908855-0781-493e-badf-1b6f6c09704b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:06.254900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64908855-0781-493e-badf-1b6f6c09704b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:06.331930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1294/2637] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:22:06 2021] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:22:06.335984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b45f-4dcc-470f-b0ab-5b0c9f845f46 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:06.347806 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131b45f-4dcc-470f-b0ab-5b0c9f845f46 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:06.352855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc55d40-9045-40a0-a3d2-16c175808710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:06.353506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55d40-9045-40a0-a3d2-16c175808710 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.353784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55d40-9045-40a0-a3d2-16c175808710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.354056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc55d40-9045-40a0-a3d2-16c175808710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.354855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc55d40-9045-40a0-a3d2-16c175808710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:06.356425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc55d40-9045-40a0-a3d2-16c175808710 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:06.367490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1344/2638] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:22:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:22:06.375669 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64908855-0781-493e-badf-1b6f6c09704b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:06.386427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64908855-0781-493e-badf-1b6f6c09704b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:06.391412 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cd8a4-18e0-4233-a165-4256d4455d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:06.392072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cd8a4-18e0-4233-a165-4256d4455d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.392431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cd8a4-18e0-4233-a165-4256d4455d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.392664 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cd8a4-18e0-4233-a165-4256d4455d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.393426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cd8a4-18e0-4233-a165-4256d4455d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:06.395000 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cd8a4-18e0-4233-a165-4256d4455d0f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:06.405060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1295/2639] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:22:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:22:06.409411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc55d40-9045-40a0-a3d2-16c175808710 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:06.421166 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc55d40-9045-40a0-a3d2-16c175808710 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:06.423710 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f0b10-b609-4381-9a52-4bbab72e1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:06.424566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0b10-b609-4381-9a52-4bbab72e1ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.425333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0b10-b609-4381-9a52-4bbab72e1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.425599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0b10-b609-4381-9a52-4bbab72e1ac0 admin admin] PATH_INFO: `/v3/projects/a325b3cbf24144ee85aa58b7db1091d5/users/b834c213c0da4e8cb1572eee2f253612/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.439678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f0b10-b609-4381-9a52-4bbab72e1ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a325b3cbf24144ee85aa58b7db1091d5, user_id=b834c213c0da4e8cb1572eee2f253612, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:06.442965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f0b10-b609-4381-9a52-4bbab72e1ac0 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:06.543318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1345/2640] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:22:06 2021] PUT /identity/v3/projects/a325b3cbf24144ee85aa58b7db1091d5/users/b834c213c0da4e8cb1572eee2f253612/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:06.555171 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707436eb-d3ad-47a9-bfcc-c01a57f1336d None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.555483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707436eb-d3ad-47a9-bfcc-c01a57f1336d None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.555755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707436eb-d3ad-47a9-bfcc-c01a57f1336d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.582879 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-707436eb-d3ad-47a9-bfcc-c01a57f1336d None None] MFA Rules not processed for user `b834c213c0da4e8cb1572eee2f253612`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:06.584074 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-707436eb-d3ad-47a9-bfcc-c01a57f1336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:06.648514 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1296/2641] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:06 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:06.652986 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f0b10-b609-4381-9a52-4bbab72e1ac0 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:06.714052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f0b10-b609-4381-9a52-4bbab72e1ac0 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:06.718838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687039e-a6f3-4bcc-be2c-255148961d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:06.719492 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687039e-a6f3-4bcc-be2c-255148961d5a admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.719772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687039e-a6f3-4bcc-be2c-255148961d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.720047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687039e-a6f3-4bcc-be2c-255148961d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.720758 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687039e-a6f3-4bcc-be2c-255148961d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:06.723267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687039e-a6f3-4bcc-be2c-255148961d5a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:06.853752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1346/2642] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:22:06 2021] POST /identity/v3/projects => generated 393 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:22:06.858237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707436eb-d3ad-47a9-bfcc-c01a57f1336d None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:06.869232 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707436eb-d3ad-47a9-bfcc-c01a57f1336d None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:06.923824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfa040-f9f0-41ec-a4bf-192cc607be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:06.924500 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa040-f9f0-41ec-a4bf-192cc607be58 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:06.925010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa040-f9f0-41ec-a4bf-192cc607be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:06.925332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa040-f9f0-41ec-a4bf-192cc607be58 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:06.926257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfa040-f9f0-41ec-a4bf-192cc607be58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:06.928363 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfa040-f9f0-41ec-a4bf-192cc607be58 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:07.029348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1297/2643] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:22:06 2021] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:22:07.042137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687039e-a6f3-4bcc-be2c-255148961d5a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:07.053877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687039e-a6f3-4bcc-be2c-255148961d5a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:07.058909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c129d5-9698-468f-bac7-00c412d4d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:07.059639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c129d5-9698-468f-bac7-00c412d4d6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:07.059956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c129d5-9698-468f-bac7-00c412d4d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:07.060286 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c129d5-9698-468f-bac7-00c412d4d6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:07.061058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c129d5-9698-468f-bac7-00c412d4d6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:07.062808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c129d5-9698-468f-bac7-00c412d4d6a8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:07.074327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1347/2644] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:22:07.078600 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfa040-f9f0-41ec-a4bf-192cc607be58 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:07.089155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfa040-f9f0-41ec-a4bf-192cc607be58 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:07.093718 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade831a-7ce4-46d9-a5db-ff788a54ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:07.094620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade831a-7ce4-46d9-a5db-ff788a54ad2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:07.094901 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade831a-7ce4-46d9-a5db-ff788a54ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:07.095174 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade831a-7ce4-46d9-a5db-ff788a54ad2e admin admin] PATH_INFO: `/v3/projects/fe550b4674ce49408744e7cb5aea0b2a/users/4aee3f814c5c448d84799301b7d05749/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:07.111722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade831a-7ce4-46d9-a5db-ff788a54ad2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe550b4674ce49408744e7cb5aea0b2a, user_id=4aee3f814c5c448d84799301b7d05749, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:07.115029 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade831a-7ce4-46d9-a5db-ff788a54ad2e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:07.183657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1298/2645] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:22:07 2021] PUT /identity/v3/projects/fe550b4674ce49408744e7cb5aea0b2a/users/4aee3f814c5c448d84799301b7d05749/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:07.187737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c129d5-9698-468f-bac7-00c412d4d6a8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:07.198354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c129d5-9698-468f-bac7-00c412d4d6a8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:07.252746 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6abdc-d4f0-4546-916a-e35d1c34a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:07.253903 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6abdc-d4f0-4546-916a-e35d1c34a5fe admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:07.254183 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6abdc-d4f0-4546-916a-e35d1c34a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:07.254452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6abdc-d4f0-4546-916a-e35d1c34a5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:07.255214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6abdc-d4f0-4546-916a-e35d1c34a5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:07.256816 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6abdc-d4f0-4546-916a-e35d1c34a5fe admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:07.266263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1348/2646] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:22:07.270550 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade831a-7ce4-46d9-a5db-ff788a54ad2e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:07.280657 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade831a-7ce4-46d9-a5db-ff788a54ad2e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:07.285839 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:07.286740 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:07.287024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:07.287297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] PATH_INFO: `/v3/projects/fe550b4674ce49408744e7cb5aea0b2a/users/4aee3f814c5c448d84799301b7d05749/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:07.289257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe550b4674ce49408744e7cb5aea0b2a, user_id=4aee3f814c5c448d84799301b7d05749, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:07.291920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:07.303472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1299/2647] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:22:07 2021] PUT /identity/v3/projects/fe550b4674ce49408744e7cb5aea0b2a/users/4aee3f814c5c448d84799301b7d05749/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:07.313794 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f292d-6a04-4bcd-b3e7-cce700ffae9f None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:07.314081 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f292d-6a04-4bcd-b3e7-cce700ffae9f None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:07.314356 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f292d-6a04-4bcd-b3e7-cce700ffae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:07.340564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7b9f292d-6a04-4bcd-b3e7-cce700ffae9f None None] MFA Rules not processed for user `4aee3f814c5c448d84799301b7d05749`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:07.341768 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7b9f292d-6a04-4bcd-b3e7-cce700ffae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:07.408440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1349/2648] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:07 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:07.418925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:07.420559 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:07.477626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c464-a0a0-4f03-b0df-add3bae86857 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:07.481614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa392213-ad72-49bf-8edc-f1442cdd0f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:07.482304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa392213-ad72-49bf-8edc-f1442cdd0f14 service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:07.482611 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa392213-ad72-49bf-8edc-f1442cdd0f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:07.483135 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa392213-ad72-49bf-8edc-f1442cdd0f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:07.492933 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa392213-ad72-49bf-8edc-f1442cdd0f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:07.494440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa392213-ad72-49bf-8edc-f1442cdd0f14 service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:07.504025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1300/2649] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:07 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:22:07.546744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f292d-6a04-4bcd-b3e7-cce700ffae9f None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:07.548138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7b9f292d-6a04-4bcd-b3e7-cce700ffae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:07.560982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f292d-6a04-4bcd-b3e7-cce700ffae9f None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:07.564801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585157d-b34e-42c8-ba6c-f7b78c146b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:07.565440 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585157d-b34e-42c8-ba6c-f7b78c146b2b service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:07.565719 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585157d-b34e-42c8-ba6c-f7b78c146b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:07.565994 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585157d-b34e-42c8-ba6c-f7b78c146b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:07.623600 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585157d-b34e-42c8-ba6c-f7b78c146b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:07.625712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585157d-b34e-42c8-ba6c-f7b78c146b2b service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:07.634971 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1350/2650] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:07 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:22:12.326177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa392213-ad72-49bf-8edc-f1442cdd0f14 service cinder] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:12.387921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa392213-ad72-49bf-8edc-f1442cdd0f14 service cinder] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:12.392532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:12.393409 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:12.393691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:12.393966 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] PATH_INFO: `/v3/users/b834c213c0da4e8cb1572eee2f253612` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:12.395350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b834c213c0da4e8cb1572eee2f253612)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:12.397863 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:12.575391 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b834c213c0da4e8cb1572eee2f253612'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:12.576067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b834c213c0da4e8cb1572eee2f253612'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:12.576702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b834c213c0da4e8cb1572eee2f253612'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:12.639762 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b834c213c0da4e8cb1572eee2f253612'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:12.653815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b834c213c0da4e8cb1572eee2f253612'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:12.668267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1301/2651] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:22:12 2021] DELETE /identity/v3/users/b834c213c0da4e8cb1572eee2f253612 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:12.673682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48178b-6b7d-4dc5-be22-642e205cb989 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:12.674629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48178b-6b7d-4dc5-be22-642e205cb989 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:12.674913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48178b-6b7d-4dc5-be22-642e205cb989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:12.695934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2a48178b-6b7d-4dc5-be22-642e205cb989 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:12.697159 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2a48178b-6b7d-4dc5-be22-642e205cb989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:12.763495 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1351/2652] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:12.773813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:12.775415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:12.835921 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23868e8f-2e0d-410f-8c00-5bb5aa22daaf admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:12.840028 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990e70-608e-4e9e-a25d-d16883967861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:12.840767 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990e70-608e-4e9e-a25d-d16883967861 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:12.841120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990e70-608e-4e9e-a25d-d16883967861 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:12.841483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12990e70-608e-4e9e-a25d-d16883967861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:12.851868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12990e70-608e-4e9e-a25d-d16883967861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:12.853347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12990e70-608e-4e9e-a25d-d16883967861 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:12.863997 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1302/2653] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:22:13.282519 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48178b-6b7d-4dc5-be22-642e205cb989 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:13.284547 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2a48178b-6b7d-4dc5-be22-642e205cb989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:13.303094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48178b-6b7d-4dc5-be22-642e205cb989 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:13.309178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:13.310172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:13.310455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:13.315004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] PATH_INFO: `/v3/projects/a325b3cbf24144ee85aa58b7db1091d5` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:13.315004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] RBAC: Authorizing `identity:delete_project(project_id=a325b3cbf24144ee85aa58b7db1091d5)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:13.315004 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:13.429899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a325b3cbf24144ee85aa58b7db1091d5', 'request_id': 'req-e30b933f-3142-477b-b119-5746aa74fced'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.491628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a325b3cbf24144ee85aa58b7db1091d5', 'request_id': 'req-e30b933f-3142-477b-b119-5746aa74fced'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.497784 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a325b3cbf24144ee85aa58b7db1091d5', 'request_id': 'req-e30b933f-3142-477b-b119-5746aa74fced'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.509481 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] The token cache is being invalidate because project a325b3cbf24144ee85aa58b7db1091d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:22:13.509774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.510442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.512015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1352/2654] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:22:13 2021] DELETE /identity/v3/projects/a325b3cbf24144ee85aa58b7db1091d5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:13.516295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990e70-608e-4e9e-a25d-d16883967861 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:13.525755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12990e70-608e-4e9e-a25d-d16883967861 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:13.583077 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:13.583952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:13.584228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:13.584497 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] PATH_INFO: `/v3/users/4aee3f814c5c448d84799301b7d05749` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:13.585714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aee3f814c5c448d84799301b7d05749)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:13.588003 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:13.813577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aee3f814c5c448d84799301b7d05749'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.814135 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aee3f814c5c448d84799301b7d05749'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.814750 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aee3f814c5c448d84799301b7d05749'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.896900 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aee3f814c5c448d84799301b7d05749'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.909154 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-71ee0647-1bda-4b46-b73c-cf63b4d4db23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aee3f814c5c448d84799301b7d05749'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:13.921313 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1303/2655] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:22:13 2021] DELETE /identity/v3/users/4aee3f814c5c448d84799301b7d05749 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:14.320946 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:14.323106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:14.336585 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b933f-3142-477b-b119-5746aa74fced admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:14.392925 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:14.393792 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:14.394071 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:14.394364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] PATH_INFO: `/v3/projects/fe550b4674ce49408744e7cb5aea0b2a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:14.396137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe550b4674ce49408744e7cb5aea0b2a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:14.398078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:14.519339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe550b4674ce49408744e7cb5aea0b2a', 'request_id': 'req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:14.588614 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe550b4674ce49408744e7cb5aea0b2a', 'request_id': 'req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:14.594322 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe550b4674ce49408744e7cb5aea0b2a', 'request_id': 'req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:14.605678 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] The token cache is being invalidate because project fe550b4674ce49408744e7cb5aea0b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:22:14.605948 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:14.606629 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-63a9c871-014a-47f0-b5d8-4ce1b6864fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:14.608230 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1353/2656] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:22:14 2021] DELETE /identity/v3/projects/fe550b4674ce49408744e7cb5aea0b2a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:14.614598 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64afe-1f3c-48d9-920b-e27a8d84ff59 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:14.615151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64afe-1f3c-48d9-920b-e27a8d84ff59 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:14.615290 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64afe-1f3c-48d9-920b-e27a8d84ff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:14.633031 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-a6e64afe-1f3c-48d9-920b-e27a8d84ff59 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:14.634219 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-a6e64afe-1f3c-48d9-920b-e27a8d84ff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:14.704155 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1304/2657] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:22:14.712555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e205d6-8172-4e6d-b16d-f162fe34ca77 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:14.712834 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e205d6-8172-4e6d-b16d-f162fe34ca77 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:14.713109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e205d6-8172-4e6d-b16d-f162fe34ca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:14.731179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b7e205d6-8172-4e6d-b16d-f162fe34ca77 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:14.732374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b7e205d6-8172-4e6d-b16d-f162fe34ca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:14.740632 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1354/2658] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:14.744789 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e64afe-1f3c-48d9-920b-e27a8d84ff59 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:14.754179 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e64afe-1f3c-48d9-920b-e27a8d84ff59 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:14.759531 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:14.760182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:14.760484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:14.760729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:14.761456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:22:14.761758 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:14.763397 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:14.774428 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1305/2659] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:22:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:22:14.778626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e205d6-8172-4e6d-b16d-f162fe34ca77 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:14.787673 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e205d6-8172-4e6d-b16d-f162fe34ca77 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:14.792267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ded4-3f25-4a7c-ae7b-8dc465d8559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:14.792904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ded4-3f25-4a7c-ae7b-8dc465d8559f admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:14.793184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ded4-3f25-4a7c-ae7b-8dc465d8559f admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:14.793457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ded4-3f25-4a7c-ae7b-8dc465d8559f admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:14.794160 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141ded4-3f25-4a7c-ae7b-8dc465d8559f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:14.796082 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141ded4-3f25-4a7c-ae7b-8dc465d8559f admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:14.882505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1355/2660] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:22:14 2021] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:22:14.885978 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:14.895855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96731d41-6717-416f-90a1-3cdd7ca99dc1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:14.949120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b126f5-3271-4b6b-ac21-cecded9f6095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:14.949784 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b126f5-3271-4b6b-ac21-cecded9f6095 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:14.950065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b126f5-3271-4b6b-ac21-cecded9f6095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:14.950341 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b126f5-3271-4b6b-ac21-cecded9f6095 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:14.951085 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b126f5-3271-4b6b-ac21-cecded9f6095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:14.952985 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b126f5-3271-4b6b-ac21-cecded9f6095 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:15.022797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1306/2661] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:22:14 2021] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:22:15.026761 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ded4-3f25-4a7c-ae7b-8dc465d8559f admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:15.037249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ded4-3f25-4a7c-ae7b-8dc465d8559f admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:15.041771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0f62-c653-4035-b8fd-14ffcaf417b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:15.042421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0f62-c653-4035-b8fd-14ffcaf417b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:15.042738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0f62-c653-4035-b8fd-14ffcaf417b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:15.043015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0f62-c653-4035-b8fd-14ffcaf417b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:15.043747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d0f62-c653-4035-b8fd-14ffcaf417b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:15.045342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d0f62-c653-4035-b8fd-14ffcaf417b4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:15.056151 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1356/2662] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:22:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:22:15.060193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b126f5-3271-4b6b-ac21-cecded9f6095 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:15.070655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b126f5-3271-4b6b-ac21-cecded9f6095 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:15.075197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11638edd-d4aa-4fb0-a5bb-728fa7473273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:15.075838 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11638edd-d4aa-4fb0-a5bb-728fa7473273 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:15.076118 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11638edd-d4aa-4fb0-a5bb-728fa7473273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:15.076390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11638edd-d4aa-4fb0-a5bb-728fa7473273 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:15.077111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11638edd-d4aa-4fb0-a5bb-728fa7473273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:15.078729 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11638edd-d4aa-4fb0-a5bb-728fa7473273 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:15.088222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1307/2663] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:22:15 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:22:15.092450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0f62-c653-4035-b8fd-14ffcaf417b4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:15.102837 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0f62-c653-4035-b8fd-14ffcaf417b4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:15.107970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:15.108847 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:15.109122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:15.109389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] PATH_INFO: `/v3/projects/eb1fd2dd9cca4aa4896d747e1a8b0b2f/users/8262b35f2f52475ba541ad64e932f013/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:15.124397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1fd2dd9cca4aa4896d747e1a8b0b2f, user_id=8262b35f2f52475ba541ad64e932f013, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:15.127070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:15.177320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1357/2664] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:22:15 2021] PUT /identity/v3/projects/eb1fd2dd9cca4aa4896d747e1a8b0b2f/users/8262b35f2f52475ba541ad64e932f013/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:15.188528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032a4bc-5cae-4e96-bdc9-fa795b9569d6 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:15.188941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032a4bc-5cae-4e96-bdc9-fa795b9569d6 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:15.189255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032a4bc-5cae-4e96-bdc9-fa795b9569d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:15.215235 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-f032a4bc-5cae-4e96-bdc9-fa795b9569d6 None None] MFA Rules not processed for user `8262b35f2f52475ba541ad64e932f013`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:15.216408 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f032a4bc-5cae-4e96-bdc9-fa795b9569d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:15.277130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1308/2665] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:15 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:15.289540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:15.291243 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:15.366475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2006-d545-427a-b3dd-55b8a02def63 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:15.370168 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994dc70-4cf9-493c-8ef8-148e8f72bb55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a061423c1f646b8892d646979f84f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:15.370842 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994dc70-4cf9-493c-8ef8-148e8f72bb55 service glance] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:15.371123 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994dc70-4cf9-493c-8ef8-148e8f72bb55 service glance] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:15.371396 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994dc70-4cf9-493c-8ef8-148e8f72bb55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:15.379970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994dc70-4cf9-493c-8ef8-148e8f72bb55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:15.381108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994dc70-4cf9-493c-8ef8-148e8f72bb55 service glance] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:15.390173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1358/2666] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:15 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:22:35.607491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032a4bc-5cae-4e96-bdc9-fa795b9569d6 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:35.695830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032a4bc-5cae-4e96-bdc9-fa795b9569d6 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:35.705717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:35.706620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:35.706904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:35.707182 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] PATH_INFO: `/v3/users/8262b35f2f52475ba541ad64e932f013` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:35.708396 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8262b35f2f52475ba541ad64e932f013)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:35.710305 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:35.898197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8262b35f2f52475ba541ad64e932f013'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:35.898929 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8262b35f2f52475ba541ad64e932f013'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:35.899581 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8262b35f2f52475ba541ad64e932f013'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:35.959104 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8262b35f2f52475ba541ad64e932f013'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:35.971848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8262b35f2f52475ba541ad64e932f013'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:35.985386 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1309/2667] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:22:35 2021] DELETE /identity/v3/users/8262b35f2f52475ba541ad64e932f013 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:35.990327 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2e4ef-58c0-4a77-b94e-4fd9ee79bb6c None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:35.990865 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2e4ef-58c0-4a77-b94e-4fd9ee79bb6c None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:35.990979 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2e4ef-58c0-4a77-b94e-4fd9ee79bb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:36.010058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-d0e2e4ef-58c0-4a77-b94e-4fd9ee79bb6c None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:36.011290 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d0e2e4ef-58c0-4a77-b94e-4fd9ee79bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:36.071974 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1359/2668] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:36.081998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:36.083522 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:36.142494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b061beb-ac48-4d0a-aa8e-4267fd27c278 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:36.146108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42169a6-4fde-4e6d-a6e9-ed5635bd6a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:36.146780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42169a6-4fde-4e6d-a6e9-ed5635bd6a4b service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:36.147064 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42169a6-4fde-4e6d-a6e9-ed5635bd6a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:36.147340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42169a6-4fde-4e6d-a6e9-ed5635bd6a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:36.157047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42169a6-4fde-4e6d-a6e9-ed5635bd6a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:36.158422 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42169a6-4fde-4e6d-a6e9-ed5635bd6a4b service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:36.168835 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1310/2669] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:22:36.572414 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2e4ef-58c0-4a77-b94e-4fd9ee79bb6c None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:36.577253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d0e2e4ef-58c0-4a77-b94e-4fd9ee79bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:36.588487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2e4ef-58c0-4a77-b94e-4fd9ee79bb6c None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:36.593366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:36.594849 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:36.595139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:36.595618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] PATH_INFO: `/v3/projects/eb1fd2dd9cca4aa4896d747e1a8b0b2f` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:36.596838 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1fd2dd9cca4aa4896d747e1a8b0b2f)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:36.598774 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:36.709852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1fd2dd9cca4aa4896d747e1a8b0b2f', 'request_id': 'req-c5393569-c191-4ccc-850d-f047a39b6482'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:36.763779 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1fd2dd9cca4aa4896d747e1a8b0b2f', 'request_id': 'req-c5393569-c191-4ccc-850d-f047a39b6482'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:36.769747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1fd2dd9cca4aa4896d747e1a8b0b2f', 'request_id': 'req-c5393569-c191-4ccc-850d-f047a39b6482'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:36.780846 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] The token cache is being invalidate because project eb1fd2dd9cca4aa4896d747e1a8b0b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:22:36.781130 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:36.781793 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c5393569-c191-4ccc-850d-f047a39b6482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:22:36.783365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1360/2670] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:22:36 2021] DELETE /identity/v3/projects/eb1fd2dd9cca4aa4896d747e1a8b0b2f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:36.789157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d79ea-14c3-4062-aa05-ece2679dba9f None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:36.789654 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d79ea-14c3-4062-aa05-ece2679dba9f None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:36.789805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d79ea-14c3-4062-aa05-ece2679dba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:36.807566 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e76d79ea-14c3-4062-aa05-ece2679dba9f None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:36.808739 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e76d79ea-14c3-4062-aa05-ece2679dba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:36.864998 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1311/2671] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:36.873398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7ddf-18d6-47bc-805f-8e57eeda9430 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:36.873682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7ddf-18d6-47bc-805f-8e57eeda9430 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:36.873957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d7ddf-18d6-47bc-805f-8e57eeda9430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:36.892276 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-1b7d7ddf-18d6-47bc-805f-8e57eeda9430 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:36.893460 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1b7d7ddf-18d6-47bc-805f-8e57eeda9430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:36.901350 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1361/2672] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:36.905558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d79ea-14c3-4062-aa05-ece2679dba9f None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:36.915167 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d79ea-14c3-4062-aa05-ece2679dba9f None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:36.919711 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:36.920365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:36.920644 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:36.920911 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:36.921659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:22:36.921958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:36.923570 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:36.935906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1312/2673] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:22:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:22:36.940048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d7ddf-18d6-47bc-805f-8e57eeda9430 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:36.950027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d7ddf-18d6-47bc-805f-8e57eeda9430 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:36.954700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bf114-f71e-47b6-ba9e-71fbbd11f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:36.955343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bf114-f71e-47b6-ba9e-71fbbd11f9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:36.955621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bf114-f71e-47b6-ba9e-71fbbd11f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:36.955892 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bf114-f71e-47b6-ba9e-71fbbd11f9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:36.956672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bf114-f71e-47b6-ba9e-71fbbd11f9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:36.958505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bf114-f71e-47b6-ba9e-71fbbd11f9b7 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:37.041272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1362/2674] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:22:36 2021] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:22:37.045270 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:37.055488 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243564a-f3b5-4867-bd6b-e0ddc7454fc9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:37.108683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675819c2-231d-4c50-b868-4417ad7575d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:37.109357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675819c2-231d-4c50-b868-4417ad7575d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:37.109647 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675819c2-231d-4c50-b868-4417ad7575d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:37.109923 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675819c2-231d-4c50-b868-4417ad7575d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:37.110661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675819c2-231d-4c50-b868-4417ad7575d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:37.112578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675819c2-231d-4c50-b868-4417ad7575d2 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:37.198640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1313/2675] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:22:37 2021] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:22:37.202734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bf114-f71e-47b6-ba9e-71fbbd11f9b7 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:37.213231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bf114-f71e-47b6-ba9e-71fbbd11f9b7 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:37.218047 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc40ef-7b16-4b68-84f1-ba129b721646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:37.218738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc40ef-7b16-4b68-84f1-ba129b721646 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:37.219022 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc40ef-7b16-4b68-84f1-ba129b721646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:37.219292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc40ef-7b16-4b68-84f1-ba129b721646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:37.220100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc40ef-7b16-4b68-84f1-ba129b721646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:37.221685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc40ef-7b16-4b68-84f1-ba129b721646 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:37.232565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1363/2676] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:22:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:22:37.236509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675819c2-231d-4c50-b868-4417ad7575d2 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:37.246884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675819c2-231d-4c50-b868-4417ad7575d2 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:37.251440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eaf99-e3c5-4799-bd20-f2b21d2bcb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:37.252081 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eaf99-e3c5-4799-bd20-f2b21d2bcb24 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:37.252362 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eaf99-e3c5-4799-bd20-f2b21d2bcb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:37.252637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eaf99-e3c5-4799-bd20-f2b21d2bcb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:37.253364 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eaf99-e3c5-4799-bd20-f2b21d2bcb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:37.254979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eaf99-e3c5-4799-bd20-f2b21d2bcb24 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:37.264499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1314/2677] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:22:37 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:22:37.268565 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc40ef-7b16-4b68-84f1-ba129b721646 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:37.278324 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc40ef-7b16-4b68-84f1-ba129b721646 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:37.283930 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:37.284823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:37.285097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:37.285364 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] PATH_INFO: `/v3/projects/cda486fa48ba43ef850a91d2cc5fca1d/users/387221e5829242db9c625f19f3ddc4ee/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:37.299722 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda486fa48ba43ef850a91d2cc5fca1d, user_id=387221e5829242db9c625f19f3ddc4ee, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:37.302360 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:37.369908 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1364/2678] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:22:37 2021] PUT /identity/v3/projects/cda486fa48ba43ef850a91d2cc5fca1d/users/387221e5829242db9c625f19f3ddc4ee/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:22:37.374983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040b59-e84d-4122-80ba-7e5e87381751 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:37.378904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040b59-e84d-4122-80ba-7e5e87381751 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:37.378904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040b59-e84d-4122-80ba-7e5e87381751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:37.393530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-51040b59-e84d-4122-80ba-7e5e87381751 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:37.394771 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-51040b59-e84d-4122-80ba-7e5e87381751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:37.453983 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1315/2679] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:37.464477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:37.466255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:37.525778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302b640-1211-4615-bd3d-3fd6e9439520 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:37.529611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:37.530277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:37.530580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:37.530864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:37.540766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:37.542221 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:37.551805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1365/2680] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:22:38.875560 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365fd63-de48-4b76-8198-a7029e79aa66 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:38.876069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365fd63-de48-4b76-8198-a7029e79aa66 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:38.876241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365fd63-de48-4b76-8198-a7029e79aa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:38.905585 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c365fd63-de48-4b76-8198-a7029e79aa66 None None] MFA Rules not processed for user `387221e5829242db9c625f19f3ddc4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:38.906937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c365fd63-de48-4b76-8198-a7029e79aa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:38.973969 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1316/2681] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:38 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:38.984646 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:38.986078 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:39.044354 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088c7df-c900-4ae7-8e85-057cb3c0e2e2 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:39.048012 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:39.048652 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:39.048937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:39.049209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:39.057936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:39.059534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:39.068599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1366/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:38 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:22:40.817039 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9b0ef-d4d0-4dc6-b6bd-3849639c21b1 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:40.823848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9b0ef-d4d0-4dc6-b6bd-3849639c21b1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:40.823848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9b0ef-d4d0-4dc6-b6bd-3849639c21b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:40.835683 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-36d9b0ef-d4d0-4dc6-b6bd-3849639c21b1 None None] MFA Rules not processed for user `387221e5829242db9c625f19f3ddc4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:40.836868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-36d9b0ef-d4d0-4dc6-b6bd-3849639c21b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:40.844059 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1317/2683] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:40 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:22:42.882566 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:22:42.884402 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:42.973300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ab0d-1b9b-472a-a0d1-3fea2c1a1afc service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:22:42.979051 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db055fddc41c4eb0ba1c3b410e1e8e03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:22:42.979723 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:42.979998 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:42.980268 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:42.982448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:42.993663 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:22:42.995285 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:22:43.006003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1367/2684] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:22:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:22:59.413250 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551d32-ae52-477f-a11b-aa7539b85b68 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:22:59.413817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551d32-ae52-477f-a11b-aa7539b85b68 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:22:59.413817 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551d32-ae52-477f-a11b-aa7539b85b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:22:59.431166 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-57551d32-ae52-477f-a11b-aa7539b85b68 None None] MFA Rules not processed for user `387221e5829242db9c625f19f3ddc4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:22:59.432834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-57551d32-ae52-477f-a11b-aa7539b85b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:22:59.439554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1318/2685] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:22:59 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:04.472430 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:04.473928 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:04.553002 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c5cca-1e73-4f54-8588-23a1b094396c service placement] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:04.559745 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:04.560405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:04.561984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:04.561984 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:04.562894 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:04.623228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:04.629058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:04.633832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1368/2686] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:23:04 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:23:11.566761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57551d32-ae52-477f-a11b-aa7539b85b68 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:11.577602 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57551d32-ae52-477f-a11b-aa7539b85b68 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:11.582079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:11.582853 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:11.583133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:11.583456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:11.585556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:11.597946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:11.599415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:11.610091 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1319/2687] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:23:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:23:15.141300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:15.142953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:15.157501 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543defa-a4a2-4cfe-a7bb-b75fe112dd72 service nova] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:15.162384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:15.163278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:15.163555 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:15.163824 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] PATH_INFO: `/v3/users/92909ef457b1401ca5c19d3c863af63e` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:15.165569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=92909ef457b1401ca5c19d3c863af63e)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:15.167648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:15.356029 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92909ef457b1401ca5c19d3c863af63e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:15.357109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92909ef457b1401ca5c19d3c863af63e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:15.358630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92909ef457b1401ca5c19d3c863af63e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:15.441822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92909ef457b1401ca5c19d3c863af63e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:15.455134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-cd1153a1-005c-4e1f-bf70-3ce32bbd1cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92909ef457b1401ca5c19d3c863af63e'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:15.467395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1369/2688] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:23:15 2021] DELETE /identity/v3/users/92909ef457b1401ca5c19d3c863af63e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:23:15.729710 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:15.742210 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7693-b5e4-41a9-9c13-515c48b039e9 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:15.806288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:15.807183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:15.807462 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:15.807731 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] PATH_INFO: `/v3/projects/7e951c2eae284261a98b317ec84140db` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:15.808946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e951c2eae284261a98b317ec84140db)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:15.811072 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:15.928057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e951c2eae284261a98b317ec84140db', 'request_id': 'req-075f0bf7-94c2-4b6f-b49e-91224b59bcce'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:16.019421 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e951c2eae284261a98b317ec84140db', 'request_id': 'req-075f0bf7-94c2-4b6f-b49e-91224b59bcce'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:16.025805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e951c2eae284261a98b317ec84140db', 'request_id': 'req-075f0bf7-94c2-4b6f-b49e-91224b59bcce'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:16.036736 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] The token cache is being invalidate because project 7e951c2eae284261a98b317ec84140db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:23:16.037016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:16.037682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-075f0bf7-94c2-4b6f-b49e-91224b59bcce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:16.039237 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1320/2689] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:23:15 2021] DELETE /identity/v3/projects/7e951c2eae284261a98b317ec84140db => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:23:16.051269 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e09a6-256b-4fd2-b3b4-eff221847ee4 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.051584 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e09a6-256b-4fd2-b3b4-eff221847ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.051907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e09a6-256b-4fd2-b3b4-eff221847ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.073381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-4c3e09a6-256b-4fd2-b3b4-eff221847ee4 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:16.074639 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4c3e09a6-256b-4fd2-b3b4-eff221847ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:16.153363 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1370/2690] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:16.164589 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5dec0-70e1-45c9-9152-7b3c69645f69 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.165404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5dec0-70e1-45c9-9152-7b3c69645f69 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.165691 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5dec0-70e1-45c9-9152-7b3c69645f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.185355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-bfc5dec0-70e1-45c9-9152-7b3c69645f69 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:16.186634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bfc5dec0-70e1-45c9-9152-7b3c69645f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:16.195821 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1321/2691] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:16.200306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e09a6-256b-4fd2-b3b4-eff221847ee4 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:16.210318 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e09a6-256b-4fd2-b3b4-eff221847ee4 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:16.215676 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:16.218717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.218717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.218717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.218717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:23:16.218717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:16.219515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:16.232015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1371/2692] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:23:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:23:16.236280 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5dec0-70e1-45c9-9152-7b3c69645f69 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:16.245367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5dec0-70e1-45c9-9152-7b3c69645f69 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:16.250082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800cc88-9796-48f0-872a-506724adfa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:16.250757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800cc88-9796-48f0-872a-506724adfa1d admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.251040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800cc88-9796-48f0-872a-506724adfa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.251317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800cc88-9796-48f0-872a-506724adfa1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.252014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800cc88-9796-48f0-872a-506724adfa1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:16.253919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800cc88-9796-48f0-872a-506724adfa1d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:16.317816 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1322/2693] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:23:16 2021] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:23:16.321732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:16.331602 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a92329-6730-4e57-bae9-76faf52f4299 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:16.390066 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26fe3-fd8c-4731-8b2e-4ffc8c402b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:16.390934 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26fe3-fd8c-4731-8b2e-4ffc8c402b05 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.391088 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26fe3-fd8c-4731-8b2e-4ffc8c402b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.391328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26fe3-fd8c-4731-8b2e-4ffc8c402b05 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.392165 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c26fe3-fd8c-4731-8b2e-4ffc8c402b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:16.393997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c26fe3-fd8c-4731-8b2e-4ffc8c402b05 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:16.510421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1372/2694] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:23:16 2021] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:23:16.514506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800cc88-9796-48f0-872a-506724adfa1d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:16.525993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800cc88-9796-48f0-872a-506724adfa1d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:16.530613 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d29cc1-0282-4037-8817-36c27a0c7598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:16.531401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d29cc1-0282-4037-8817-36c27a0c7598 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.534452 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d29cc1-0282-4037-8817-36c27a0c7598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.534759 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d29cc1-0282-4037-8817-36c27a0c7598 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.535520 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d29cc1-0282-4037-8817-36c27a0c7598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:16.537110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d29cc1-0282-4037-8817-36c27a0c7598 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:16.547619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1323/2695] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:23:16.552451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26fe3-fd8c-4731-8b2e-4ffc8c402b05 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:16.562507 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26fe3-fd8c-4731-8b2e-4ffc8c402b05 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:16.567175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b2b25-1383-44e3-8930-d146641e692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:16.567884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b2b25-1383-44e3-8930-d146641e692b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.568102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b2b25-1383-44e3-8930-d146641e692b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.568372 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b2b25-1383-44e3-8930-d146641e692b admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.569100 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b2b25-1383-44e3-8930-d146641e692b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:16.570749 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b2b25-1383-44e3-8930-d146641e692b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:16.581208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1373/2696] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:23:16.585757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d29cc1-0282-4037-8817-36c27a0c7598 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:16.596148 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d29cc1-0282-4037-8817-36c27a0c7598 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:16.600733 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:16.603382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.603382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.603382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] PATH_INFO: `/v3/projects/c02f323bd05c4d6bbbadfb2cf91bd62d/users/a82113bec9a943aba997af6c747f6cdb/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.616925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02f323bd05c4d6bbbadfb2cf91bd62d, user_id=a82113bec9a943aba997af6c747f6cdb, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:16.619695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:16.681506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1324/2697] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:23:16 2021] PUT /identity/v3/projects/c02f323bd05c4d6bbbadfb2cf91bd62d/users/a82113bec9a943aba997af6c747f6cdb/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:23:16.686536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d491-1ba1-45ff-9a89-31302e2c21f0 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.686850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d491-1ba1-45ff-9a89-31302e2c21f0 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.687128 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d491-1ba1-45ff-9a89-31302e2c21f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.705254 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-66e4d491-1ba1-45ff-9a89-31302e2c21f0 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:16.706443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-66e4d491-1ba1-45ff-9a89-31302e2c21f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:16.766619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1374/2698] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:16.777231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:16.779058 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:16.843060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47565c8e-3496-4788-8501-71763f16fcff admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:16.847044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb793f2c-929d-4df7-a46e-8e81508d4efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:16.847795 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793f2c-929d-4df7-a46e-8e81508d4efa service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:16.848130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793f2c-929d-4df7-a46e-8e81508d4efa service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:16.848404 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb793f2c-929d-4df7-a46e-8e81508d4efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:16.860311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb793f2c-929d-4df7-a46e-8e81508d4efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:16.861754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb793f2c-929d-4df7-a46e-8e81508d4efa service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:16.873808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1325/2699] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:23:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:23:18.334672 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5bf8-e553-4c76-a9d0-3b87c749851b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:18.335494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5bf8-e553-4c76-a9d0-3b87c749851b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:18.335494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5bf8-e553-4c76-a9d0-3b87c749851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:18.363559 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-dd8e5bf8-e553-4c76-a9d0-3b87c749851b None None] MFA Rules not processed for user `a82113bec9a943aba997af6c747f6cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:18.364786 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dd8e5bf8-e553-4c76-a9d0-3b87c749851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:18.431957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1375/2700] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:18 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:18.443140 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ab699-4371-4efa-9108-cdb9886f0d9b None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:18.443704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ab699-4371-4efa-9108-cdb9886f0d9b None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:18.443704 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ab699-4371-4efa-9108-cdb9886f0d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:18.463451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-cd0ab699-4371-4efa-9108-cdb9886f0d9b None None] MFA Rules not processed for user `a82113bec9a943aba997af6c747f6cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:18.464665 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-cd0ab699-4371-4efa-9108-cdb9886f0d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:18.471670 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1326/2701] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:18 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:18.484462 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5bf8-e553-4c76-a9d0-3b87c749851b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:18.486179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-dd8e5bf8-e553-4c76-a9d0-3b87c749851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:18.562134 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5bf8-e553-4c76-a9d0-3b87c749851b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:18.567690 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:18.568339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:18.568624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:18.568901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:18.577431 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:18.578959 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:18.588271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1376/2702] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:23:18 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:23:23.471719 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799ec4-e390-439f-a353-3dc4a3583dca None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:23.472253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799ec4-e390-439f-a353-3dc4a3583dca None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:23.472253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799ec4-e390-439f-a353-3dc4a3583dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:23.490277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-1b799ec4-e390-439f-a353-3dc4a3583dca None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:23.495037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-1b799ec4-e390-439f-a353-3dc4a3583dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:23.553437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1327/2703] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:23:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:23.720500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:23.722037 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:23.792272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d23881-0046-4ab8-ae35-248fb68c0f43 service nova] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:23.797533 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e109b0-928d-4040-9b11-90657d03f633 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:23.799563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e109b0-928d-4040-9b11-90657d03f633 service swift] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:23.799563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e109b0-928d-4040-9b11-90657d03f633 service swift] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:23.799563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e109b0-928d-4040-9b11-90657d03f633 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:23.808309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e109b0-928d-4040-9b11-90657d03f633 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:23.810122 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e109b0-928d-4040-9b11-90657d03f633 service swift] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:23.819701 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1377/2704] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:23:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:23:41.751834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada623a-d381-4037-8253-67da5bdec8c4 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:41.752319 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada623a-d381-4037-8253-67da5bdec8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:41.752443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada623a-d381-4037-8253-67da5bdec8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:41.770241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-fada623a-d381-4037-8253-67da5bdec8c4 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:41.771382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fada623a-d381-4037-8253-67da5bdec8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:41.778418 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1328/2705] 10.222.0.16 () {58 vars in 967 bytes} [Thu Nov 11 17:23:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:41.791487 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e109b0-928d-4040-9b11-90657d03f633 service swift] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:41.801997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e109b0-928d-4040-9b11-90657d03f633 service swift] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:41.811320 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12510f03-e062-4522-a78f-cd8701fba7aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:41.812003 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12510f03-e062-4522-a78f-cd8701fba7aa service swift] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:41.812282 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12510f03-e062-4522-a78f-cd8701fba7aa service swift] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:41.812554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12510f03-e062-4522-a78f-cd8701fba7aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:41.824571 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12510f03-e062-4522-a78f-cd8701fba7aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:41.826179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12510f03-e062-4522-a78f-cd8701fba7aa service swift] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:41.839705 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1378/2706] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:23:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:23:44.624076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada623a-d381-4037-8253-67da5bdec8c4 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:44.626238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fada623a-d381-4037-8253-67da5bdec8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:44.641875 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada623a-d381-4037-8253-67da5bdec8c4 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:44.646970 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:44.648682 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:44.648962 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:44.649414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] PATH_INFO: `/v3/users/387221e5829242db9c625f19f3ddc4ee` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:44.651477 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=387221e5829242db9c625f19f3ddc4ee)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:44.652728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:44.801588 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387221e5829242db9c625f19f3ddc4ee'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:44.802229 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387221e5829242db9c625f19f3ddc4ee'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:44.802919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387221e5829242db9c625f19f3ddc4ee'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:44.850967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387221e5829242db9c625f19f3ddc4ee'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:44.862579 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d8a7a11f-9ea0-4f84-8d15-d7492b71d3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387221e5829242db9c625f19f3ddc4ee'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:44.875019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1329/2707] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:23:44 2021] DELETE /identity/v3/users/387221e5829242db9c625f19f3ddc4ee => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:23:45.137490 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12510f03-e062-4522-a78f-cd8701fba7aa service swift] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:45.149436 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12510f03-e062-4522-a78f-cd8701fba7aa service swift] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:45.208910 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:45.209760 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.210039 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.210306 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] PATH_INFO: `/v3/projects/cda486fa48ba43ef850a91d2cc5fca1d` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.211563 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda486fa48ba43ef850a91d2cc5fca1d)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:45.213437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:45.336531 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda486fa48ba43ef850a91d2cc5fca1d', 'request_id': 'req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:45.400218 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda486fa48ba43ef850a91d2cc5fca1d', 'request_id': 'req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:45.406094 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda486fa48ba43ef850a91d2cc5fca1d', 'request_id': 'req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:45.418024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] The token cache is being invalidate because project cda486fa48ba43ef850a91d2cc5fca1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:23:45.418308 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:45.418962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d4e8d1b7-fbd3-431b-8e6c-0713ef593cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:23:45.420500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1379/2708] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:23:45 2021] DELETE /identity/v3/projects/cda486fa48ba43ef850a91d2cc5fca1d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:23:45.434374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c08563-0897-4254-af95-70d571fb8fd1 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.434695 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c08563-0897-4254-af95-70d571fb8fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.434973 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c08563-0897-4254-af95-70d571fb8fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.454043 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-66c08563-0897-4254-af95-70d571fb8fd1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:45.454967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-66c08563-0897-4254-af95-70d571fb8fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:45.523977 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1330/2709] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:45.527343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636c1b2-904d-4f6d-a6ee-be394df3c522 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.527625 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636c1b2-904d-4f6d-a6ee-be394df3c522 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.527899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636c1b2-904d-4f6d-a6ee-be394df3c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.547074 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-8636c1b2-904d-4f6d-a6ee-be394df3c522 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:45.548264 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-8636c1b2-904d-4f6d-a6ee-be394df3c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:45.557067 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1380/2710] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:45.561410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c08563-0897-4254-af95-70d571fb8fd1 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:45.571105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c08563-0897-4254-af95-70d571fb8fd1 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:45.575625 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:45.576274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.576554 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.578926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.578926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:23:45.578926 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:45.579492 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:45.591893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1331/2711] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:23:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:23:45.596247 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636c1b2-904d-4f6d-a6ee-be394df3c522 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:45.605961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636c1b2-904d-4f6d-a6ee-be394df3c522 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:45.610586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23869a6-661e-438a-9d41-2327f74e6b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:45.611229 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23869a6-661e-438a-9d41-2327f74e6b63 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.611506 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23869a6-661e-438a-9d41-2327f74e6b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.611777 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23869a6-661e-438a-9d41-2327f74e6b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.612478 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23869a6-661e-438a-9d41-2327f74e6b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:45.614348 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23869a6-661e-438a-9d41-2327f74e6b63 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:45.750158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1381/2712] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:23:45 2021] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:23:45.754233 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:45.764189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181cad-337b-40f5-b943-182abe26fc9a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:45.820342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1e976-809e-423c-9b86-9ac99a6c9ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:45.821178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1e976-809e-423c-9b86-9ac99a6c9ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.821516 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1e976-809e-423c-9b86-9ac99a6c9ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.821808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1e976-809e-423c-9b86-9ac99a6c9ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.822801 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1e976-809e-423c-9b86-9ac99a6c9ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:45.833284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1e976-809e-423c-9b86-9ac99a6c9ae1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:45.900993 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0af7-8211-45c8-8b73-8ae2df50fd14 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.901404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0af7-8211-45c8-8b73-8ae2df50fd14 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.901744 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0af7-8211-45c8-8b73-8ae2df50fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.920070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-6c6a0af7-8211-45c8-8b73-8ae2df50fd14 None None] MFA Rules not processed for user `a82113bec9a943aba997af6c747f6cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:45.920549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1332/2713] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:23:45 2021] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:23:45.921361 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-6c6a0af7-8211-45c8-8b73-8ae2df50fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:45.924626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1e976-809e-423c-9b86-9ac99a6c9ae1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:45.934442 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1e976-809e-423c-9b86-9ac99a6c9ae1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:45.939377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc296-a01f-482b-943a-7bcbadd398c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:45.940042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc296-a01f-482b-943a-7bcbadd398c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.940412 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc296-a01f-482b-943a-7bcbadd398c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.940804 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc296-a01f-482b-943a-7bcbadd398c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.941587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc296-a01f-482b-943a-7bcbadd398c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:45.943209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc296-a01f-482b-943a-7bcbadd398c6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:45.957596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1333/2714] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:23:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:23:45.958915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc296-a01f-482b-943a-7bcbadd398c6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:45.969650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc296-a01f-482b-943a-7bcbadd398c6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:45.974486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f274d2e-7666-49a9-bdf2-6e87e1ee0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:45.975236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f274d2e-7666-49a9-bdf2-6e87e1ee0454 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:45.975592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f274d2e-7666-49a9-bdf2-6e87e1ee0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:45.975876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f274d2e-7666-49a9-bdf2-6e87e1ee0454 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:45.977147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1382/2715] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:45 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:23:45.977369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f274d2e-7666-49a9-bdf2-6e87e1ee0454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:45.979092 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f274d2e-7666-49a9-bdf2-6e87e1ee0454 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:45.991529 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1334/2716] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:23:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:23:45.995805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0af7-8211-45c8-8b73-8ae2df50fd14 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:46.006966 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0af7-8211-45c8-8b73-8ae2df50fd14 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:46.010912 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:46.011788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:46.012070 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:46.012369 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] PATH_INFO: `/v3/projects/53c4ca7574da4b2a868a39a52a98e620/users/ee78fdb600b24b3eb455dea681814a38/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:46.028654 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c4ca7574da4b2a868a39a52a98e620, user_id=ee78fdb600b24b3eb455dea681814a38, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:46.032373 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:46.097000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1383/2717] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:23:45 2021] PUT /identity/v3/projects/53c4ca7574da4b2a868a39a52a98e620/users/ee78fdb600b24b3eb455dea681814a38/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:23:46.102756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85805c0d-3204-4b35-a754-c70f11be6d96 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:46.103040 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85805c0d-3204-4b35-a754-c70f11be6d96 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:46.103307 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85805c0d-3204-4b35-a754-c70f11be6d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:46.120208 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-85805c0d-3204-4b35-a754-c70f11be6d96 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:46.121414 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-85805c0d-3204-4b35-a754-c70f11be6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:46.189626 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1335/2718] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:46.201569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:46.203510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:46.249281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85805c0d-3204-4b35-a754-c70f11be6d96 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:46.250678 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-85805c0d-3204-4b35-a754-c70f11be6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:46.263628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5acbec-4790-4485-a660-e76f2e46b1ee admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:46.267618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732264c6-96a9-4648-92e9-7bdc5aaf299c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:46.268261 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732264c6-96a9-4648-92e9-7bdc5aaf299c service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:46.268537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732264c6-96a9-4648-92e9-7bdc5aaf299c service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:46.268808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732264c6-96a9-4648-92e9-7bdc5aaf299c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:46.279805 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732264c6-96a9-4648-92e9-7bdc5aaf299c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:46.282021 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732264c6-96a9-4648-92e9-7bdc5aaf299c service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:46.291889 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1384/2719] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:23:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:23:46.309108 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85805c0d-3204-4b35-a754-c70f11be6d96 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:46.312761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:46.313410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:46.313690 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:46.313972 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:46.315868 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:46.326009 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:46.327461 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:46.336207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1336/2720] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:23:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:23:53.725224 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24751e25-4b04-4e39-879c-26aee845ae54 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:53.725850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24751e25-4b04-4e39-879c-26aee845ae54 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:53.725850 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24751e25-4b04-4e39-879c-26aee845ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:53.754309 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-24751e25-4b04-4e39-879c-26aee845ae54 None None] MFA Rules not processed for user `ee78fdb600b24b3eb455dea681814a38`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:23:53.755769 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-24751e25-4b04-4e39-879c-26aee845ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:23:53.837950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1385/2721] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:23:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:23:53.842776 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:53.866030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d94e4-3fc1-48d4-a318-7144553cf323 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:53.871556 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a38a-9a3b-49ed-ae29-692e463bc9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:53.882982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a38a-9a3b-49ed-ae29-692e463bc9ad admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:53.885021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a38a-9a3b-49ed-ae29-692e463bc9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:53.885021 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a38a-9a3b-49ed-ae29-692e463bc9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:53.886760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a38a-9a3b-49ed-ae29-692e463bc9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:53.889387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a38a-9a3b-49ed-ae29-692e463bc9ad admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:54.017963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1337/2722] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:23:53 2021] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:23:54.019483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24751e25-4b04-4e39-879c-26aee845ae54 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:54.035393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24751e25-4b04-4e39-879c-26aee845ae54 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:54.132773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a44bf7-3fac-43a5-88e4-118f7e24d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:54.135332 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44bf7-3fac-43a5-88e4-118f7e24d907 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:54.135810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44bf7-3fac-43a5-88e4-118f7e24d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:54.136374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44bf7-3fac-43a5-88e4-118f7e24d907 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:54.137317 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a44bf7-3fac-43a5-88e4-118f7e24d907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:54.139942 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a44bf7-3fac-43a5-88e4-118f7e24d907 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:54.256433 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1386/2723] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:23:54 2021] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:23:54.261142 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a38a-9a3b-49ed-ae29-692e463bc9ad admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:54.272887 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a38a-9a3b-49ed-ae29-692e463bc9ad admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:54.279499 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08187942-7f48-4a03-801c-b508c498265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:54.280395 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187942-7f48-4a03-801c-b508c498265c admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:54.280815 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187942-7f48-4a03-801c-b508c498265c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:54.281100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187942-7f48-4a03-801c-b508c498265c admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:54.281871 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08187942-7f48-4a03-801c-b508c498265c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:54.283951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08187942-7f48-4a03-801c-b508c498265c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:54.295557 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1338/2724] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:23:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:23:54.299505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a44bf7-3fac-43a5-88e4-118f7e24d907 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:54.317046 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a44bf7-3fac-43a5-88e4-118f7e24d907 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:54.323976 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698df8c-cea8-44bc-9da1-ee81436b092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:54.324899 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698df8c-cea8-44bc-9da1-ee81436b092a admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:54.325176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698df8c-cea8-44bc-9da1-ee81436b092a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:54.325508 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698df8c-cea8-44bc-9da1-ee81436b092a admin admin] PATH_INFO: `/v3/projects/8095b1a7a6bf4328a88245aa063676bf/users/e33085db8f1043b1b4261e300ce80292/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:54.347489 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698df8c-cea8-44bc-9da1-ee81436b092a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8095b1a7a6bf4328a88245aa063676bf, user_id=e33085db8f1043b1b4261e300ce80292, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:54.351599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698df8c-cea8-44bc-9da1-ee81436b092a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:54.480289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1387/2725] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:23:54 2021] PUT /identity/v3/projects/8095b1a7a6bf4328a88245aa063676bf/users/e33085db8f1043b1b4261e300ce80292/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:23:54.484294 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08187942-7f48-4a03-801c-b508c498265c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:54.500496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08187942-7f48-4a03-801c-b508c498265c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:54.573592 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cba1f4-cedc-470e-b900-231d3abf4fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:54.574461 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba1f4-cedc-470e-b900-231d3abf4fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:54.574797 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba1f4-cedc-470e-b900-231d3abf4fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:54.575069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba1f4-cedc-470e-b900-231d3abf4fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:54.575803 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cba1f4-cedc-470e-b900-231d3abf4fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:54.577393 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cba1f4-cedc-470e-b900-231d3abf4fd5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:54.592069 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1339/2726] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:23:54 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:23:54.593382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698df8c-cea8-44bc-9da1-ee81436b092a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:23:54.605152 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698df8c-cea8-44bc-9da1-ee81436b092a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:23:54.610241 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:23:54.611415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:23:54.614917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:23:54.614917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] PATH_INFO: `/v3/projects/8095b1a7a6bf4328a88245aa063676bf/users/e33085db8f1043b1b4261e300ce80292/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:23:54.614917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8095b1a7a6bf4328a88245aa063676bf, user_id=e33085db8f1043b1b4261e300ce80292, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:23:54.616810 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:23:54.627539 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1388/2727] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:23:54 2021] PUT /identity/v3/projects/8095b1a7a6bf4328a88245aa063676bf/users/e33085db8f1043b1b4261e300ce80292/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:24:00.673720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98905985-5e40-4a4a-80c7-ccd559087ab5 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:00.677052 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98905985-5e40-4a4a-80c7-ccd559087ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:00.677336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98905985-5e40-4a4a-80c7-ccd559087ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:00.734532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-98905985-5e40-4a4a-80c7-ccd559087ab5 None None] MFA Rules not processed for user `e33085db8f1043b1b4261e300ce80292`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:24:00.741430 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-98905985-5e40-4a4a-80c7-ccd559087ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:00.905346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1340/2728] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:24:00 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:24:00.914649 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:00.919417 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:01.044833 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d67-567b-40f8-a598-f757e2a7aabd admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:01.054771 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8991b-da63-43c7-826a-2e0bdd3b1935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:01.055450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8991b-da63-43c7-826a-2e0bdd3b1935 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:01.055788 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8991b-da63-43c7-826a-2e0bdd3b1935 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:01.056068 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8991b-da63-43c7-826a-2e0bdd3b1935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:01.124312 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8991b-da63-43c7-826a-2e0bdd3b1935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:01.126040 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8991b-da63-43c7-826a-2e0bdd3b1935 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:01.137032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1389/2729] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:24:00 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:24:04.086828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661622-ba61-413e-9fe2-b755ef0bd833 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:04.087389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661622-ba61-413e-9fe2-b755ef0bd833 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:04.087389 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661622-ba61-413e-9fe2-b755ef0bd833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:04.106281 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-8b661622-ba61-413e-9fe2-b755ef0bd833 None None] MFA Rules not processed for user `a82113bec9a943aba997af6c747f6cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:24:04.112342 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8b661622-ba61-413e-9fe2-b755ef0bd833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:04.180041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1341/2730] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:24:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:24:04.348736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653634-fc8b-4f56-b0c9-ac737838a399 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:04.349645 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653634-fc8b-4f56-b0c9-ac737838a399 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:04.350113 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7653634-fc8b-4f56-b0c9-ac737838a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:04.380568 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-b7653634-fc8b-4f56-b0c9-ac737838a399 None None] MFA Rules not processed for user `ee78fdb600b24b3eb455dea681814a38`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:24:04.382660 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-b7653634-fc8b-4f56-b0c9-ac737838a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:04.399897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1390/2731] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:24:04 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:24:07.753241 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b661622-ba61-413e-9fe2-b755ef0bd833 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:07.810646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b661622-ba61-413e-9fe2-b755ef0bd833 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:07.815353 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:07.816057 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:07.817236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:07.817236 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:07.819079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:07.888860 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:07.890314 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:07.900924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1342/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:24:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:24:15.740583 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7653634-fc8b-4f56-b0c9-ac737838a399 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:15.750388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7653634-fc8b-4f56-b0c9-ac737838a399 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:15.753956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:15.754626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:15.754909 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:15.755185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:15.757560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:15.771776 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:15.773239 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:15.785102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1391/2733] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:24:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:24:17.222756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:17.224821 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:17.237139 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413767-8a89-4de7-9d1d-83276a8ade85 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:17.242517 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:17.243437 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:17.243713 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:17.248014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] PATH_INFO: `/v3/users/97c82e393b164313ad7a95eca6b65c26` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:17.248014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c82e393b164313ad7a95eca6b65c26)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:17.248014 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:17.405185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c82e393b164313ad7a95eca6b65c26'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:17.405873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c82e393b164313ad7a95eca6b65c26'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:17.406443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c82e393b164313ad7a95eca6b65c26'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:17.540267 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c82e393b164313ad7a95eca6b65c26'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:17.553810 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c82e393b164313ad7a95eca6b65c26'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:17.566646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1343/2734] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:24:17 2021] DELETE /identity/v3/users/97c82e393b164313ad7a95eca6b65c26 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:24:17.811589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:17.822416 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d97d3-f592-4672-8416-c56f67d9003d service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:17.879174 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:17.880025 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:17.880334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:17.880640 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] PATH_INFO: `/v3/projects/10bedfb35d1e481aa78e025489c1be2d` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:17.881854 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bedfb35d1e481aa78e025489c1be2d)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:17.883817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:17.969560 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bedfb35d1e481aa78e025489c1be2d', 'request_id': 'req-f814d0f0-f8c0-4c55-b37e-7d3348705a95'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.015027 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bedfb35d1e481aa78e025489c1be2d', 'request_id': 'req-f814d0f0-f8c0-4c55-b37e-7d3348705a95'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.021477 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bedfb35d1e481aa78e025489c1be2d', 'request_id': 'req-f814d0f0-f8c0-4c55-b37e-7d3348705a95'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.033730 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] The token cache is being invalidate because project 10bedfb35d1e481aa78e025489c1be2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:24:18.034013 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.034727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.036321 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1392/2735] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:24:17 2021] DELETE /identity/v3/projects/10bedfb35d1e481aa78e025489c1be2d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:24:18.040937 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:18.042413 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:18.056027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648230d-9303-4e3a-8c06-158477efb61b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:18.115332 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:18.116209 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:18.116485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:18.116756 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] PATH_INFO: `/v3/users/147031f43265455081cb539cf5717147` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:18.117955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147031f43265455081cb539cf5717147)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:18.119889 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:18.317301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147031f43265455081cb539cf5717147'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.318323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147031f43265455081cb539cf5717147'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.319037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147031f43265455081cb539cf5717147'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.387567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147031f43265455081cb539cf5717147'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.411255 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147031f43265455081cb539cf5717147'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:18.429474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1344/2736] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:24:18 2021] DELETE /identity/v3/users/147031f43265455081cb539cf5717147 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:24:18.715157 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:18.716775 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:18.732396 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814d0f0-f8c0-4c55-b37e-7d3348705a95 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:18.795670 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:18.796529 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:18.796813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:18.797093 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] PATH_INFO: `/v3/projects/ab572ed9fb234e2eb59dd278b16bf840` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:18.798393 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab572ed9fb234e2eb59dd278b16bf840)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:18.800334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:18.929444 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab572ed9fb234e2eb59dd278b16bf840', 'request_id': 'req-5a148588-a336-443e-91de-451725be05d1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:19.003245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab572ed9fb234e2eb59dd278b16bf840', 'request_id': 'req-5a148588-a336-443e-91de-451725be05d1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:19.009488 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab572ed9fb234e2eb59dd278b16bf840', 'request_id': 'req-5a148588-a336-443e-91de-451725be05d1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:19.020619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] The token cache is being invalidate because project ab572ed9fb234e2eb59dd278b16bf840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:24:19.021394 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:19.022031 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-5a148588-a336-443e-91de-451725be05d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:24:19.023598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1393/2737] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:24:18 2021] DELETE /identity/v3/projects/ab572ed9fb234e2eb59dd278b16bf840 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:24:25.375120 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:25.376717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:25.440304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f894-ba52-430f-838b-7f49ac28f257 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:25.491122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:25.491994 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:25.492274 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:25.492545 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:25.494392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:25.563832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:25.565481 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:25.576722 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1345/2738] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:24:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:24:31.173114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c2a9-b40a-4965-94b6-55649c1e8363 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:31.173648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c2a9-b40a-4965-94b6-55649c1e8363 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:31.173648 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c2a9-b40a-4965-94b6-55649c1e8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:31.192397 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-7880c2a9-b40a-4965-94b6-55649c1e8363 None None] MFA Rules not processed for user `a82113bec9a943aba997af6c747f6cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:24:31.193661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-7880c2a9-b40a-4965-94b6-55649c1e8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:31.247783 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1394/2739] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:24:31 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:24:41.403906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:41.405420 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:41.416734 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3134708-2701-44b1-a3ab-3b952364f138 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:41.420439 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:41.431411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:41.431411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:41.431411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:41.431411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:41.433277 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:41.434746 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:41.443373 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1346/2740] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:24:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:24:43.766178 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c2a9-b40a-4965-94b6-55649c1e8363 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:24:43.775773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c2a9-b40a-4965-94b6-55649c1e8363 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:24:43.779412 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:24:43.780072 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:24:43.780349 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:24:43.780624 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:24:43.782371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:24:43.843543 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:24:43.844993 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:24:43.856009 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1395/2741] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:24:43 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:25:01.673472 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:01.675603 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:25:01.700284 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51871034-d2a3-4b69-8124-414a83906de1 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:01.707310 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:01.707976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:01.708257 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:01.708537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:01.711147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:25:01.726292 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:01.727952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:01.740355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1347/2742] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:25:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:25:18.320740 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:18.324299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:25:18.413124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f690a7-12a4-4a24-bea9-c851c8666b9c service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:18.419443 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:18.420736 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:18.421294 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:18.421626 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] PATH_INFO: `/v3/users/a82113bec9a943aba997af6c747f6cdb` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:18.424700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82113bec9a943aba997af6c747f6cdb)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:18.427109 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:18.616452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82113bec9a943aba997af6c747f6cdb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:18.617508 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82113bec9a943aba997af6c747f6cdb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:18.618483 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82113bec9a943aba997af6c747f6cdb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:18.714048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82113bec9a943aba997af6c747f6cdb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:18.734080 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-c440e711-fd22-4a67-a3f7-9b06f04c1aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82113bec9a943aba997af6c747f6cdb'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:18.757315 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1396/2743] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:25:18 2021] DELETE /identity/v3/users/a82113bec9a943aba997af6c747f6cdb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:25:19.054062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:19.067876 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b581f8-4526-4792-960c-90897074cfbc service nova] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:19.150276 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:19.151095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:19.151375 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:19.151650 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] PATH_INFO: `/v3/projects/c02f323bd05c4d6bbbadfb2cf91bd62d` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:19.153027 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02f323bd05c4d6bbbadfb2cf91bd62d)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:19.155095 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:19.304981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02f323bd05c4d6bbbadfb2cf91bd62d', 'request_id': 'req-3264c489-7721-4c52-86f1-4f2992f1fbc0'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:19.382728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02f323bd05c4d6bbbadfb2cf91bd62d', 'request_id': 'req-3264c489-7721-4c52-86f1-4f2992f1fbc0'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:19.390311 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02f323bd05c4d6bbbadfb2cf91bd62d', 'request_id': 'req-3264c489-7721-4c52-86f1-4f2992f1fbc0'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:19.403928 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] The token cache is being invalidate because project c02f323bd05c4d6bbbadfb2cf91bd62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:25:19.404219 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:19.404888 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-3264c489-7721-4c52-86f1-4f2992f1fbc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:25:19.406475 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1348/2744] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:25:19 2021] DELETE /identity/v3/projects/c02f323bd05c4d6bbbadfb2cf91bd62d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:25:19.413807 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba7f3-0072-431e-9761-414f983a4dc1 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:19.417227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba7f3-0072-431e-9761-414f983a4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:19.417227 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba7f3-0072-431e-9761-414f983a4dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:19.437965 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-119ba7f3-0072-431e-9761-414f983a4dc1 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:25:19.439860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-119ba7f3-0072-431e-9761-414f983a4dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:25:19.507395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1397/2745] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:25:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:25:19.515864 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c41bd-2cc2-4730-87ce-919e1ee38f9a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:19.516147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c41bd-2cc2-4730-87ce-919e1ee38f9a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:19.516426 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c41bd-2cc2-4730-87ce-919e1ee38f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:19.536180 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-696c41bd-2cc2-4730-87ce-919e1ee38f9a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:25:19.537489 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-696c41bd-2cc2-4730-87ce-919e1ee38f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:25:19.546874 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1349/2746] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:25:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:25:19.552593 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba7f3-0072-431e-9761-414f983a4dc1 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:19.562727 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba7f3-0072-431e-9761-414f983a4dc1 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:19.568992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:19.570173 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:19.570712 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:19.571213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:19.572613 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:25:19.573155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:19.575868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:19.589378 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1398/2747] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:25:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:25:19.595873 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c41bd-2cc2-4730-87ce-919e1ee38f9a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:19.606253 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c41bd-2cc2-4730-87ce-919e1ee38f9a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:19.611836 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b06cc-fc94-464b-8aab-5fea2e602aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:19.612596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b06cc-fc94-464b-8aab-5fea2e602aef admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:19.613010 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b06cc-fc94-464b-8aab-5fea2e602aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:19.613333 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b06cc-fc94-464b-8aab-5fea2e602aef admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:19.614109 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b06cc-fc94-464b-8aab-5fea2e602aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:19.616927 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b06cc-fc94-464b-8aab-5fea2e602aef admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:19.740910 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1350/2748] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:25:19 2021] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:25:19.746245 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:19.764762 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7380f-b190-4b73-9828-e11634bc220c admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:19.826765 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c61d3-cefc-4ffa-b8ce-46ebad8d5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:19.827447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c61d3-cefc-4ffa-b8ce-46ebad8d5cdb admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:19.827726 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c61d3-cefc-4ffa-b8ce-46ebad8d5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:19.828255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c61d3-cefc-4ffa-b8ce-46ebad8d5cdb admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:19.828969 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c61d3-cefc-4ffa-b8ce-46ebad8d5cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:19.830961 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c61d3-cefc-4ffa-b8ce-46ebad8d5cdb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:19.927184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1399/2749] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:25:19 2021] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:25:19.933904 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b06cc-fc94-464b-8aab-5fea2e602aef admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:19.948486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b06cc-fc94-464b-8aab-5fea2e602aef admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:19.953850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d429d8-682e-47a4-916b-89b2ab112be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:19.954535 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d429d8-682e-47a4-916b-89b2ab112be5 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:19.955231 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d429d8-682e-47a4-916b-89b2ab112be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:19.955506 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d429d8-682e-47a4-916b-89b2ab112be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:19.956268 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d429d8-682e-47a4-916b-89b2ab112be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:19.957915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d429d8-682e-47a4-916b-89b2ab112be5 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:19.970503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1351/2750] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:25:19 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:25:19.975272 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c61d3-cefc-4ffa-b8ce-46ebad8d5cdb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:19.987300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c61d3-cefc-4ffa-b8ce-46ebad8d5cdb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:19.992609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeef24-bfa0-4b16-b4a9-d33cdf05e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:19.993194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeef24-bfa0-4b16-b4a9-d33cdf05e10d admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:19.993474 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeef24-bfa0-4b16-b4a9-d33cdf05e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:19.993750 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeef24-bfa0-4b16-b4a9-d33cdf05e10d admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:19.994503 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeef24-bfa0-4b16-b4a9-d33cdf05e10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:19.996299 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeef24-bfa0-4b16-b4a9-d33cdf05e10d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:20.008163 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1400/2751] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:25:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:25:20.012783 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d429d8-682e-47a4-916b-89b2ab112be5 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:20.026147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d429d8-682e-47a4-916b-89b2ab112be5 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:20.034169 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fda05-e3cf-4f1c-bf73-5c3b9f357e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:20.035867 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fda05-e3cf-4f1c-bf73-5c3b9f357e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.036350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fda05-e3cf-4f1c-bf73-5c3b9f357e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.036848 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fda05-e3cf-4f1c-bf73-5c3b9f357e90 admin admin] PATH_INFO: `/v3/projects/6c4e05b03cd941ea83ba240d14ae14cb/users/c72cf91771104ec5a2715077e3560196/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.057383 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fda05-e3cf-4f1c-bf73-5c3b9f357e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4e05b03cd941ea83ba240d14ae14cb, user_id=c72cf91771104ec5a2715077e3560196, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:20.060480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fda05-e3cf-4f1c-bf73-5c3b9f357e90 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:20.143453 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1352/2752] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:25:20 2021] PUT /identity/v3/projects/6c4e05b03cd941ea83ba240d14ae14cb/users/c72cf91771104ec5a2715077e3560196/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:25:20.155516 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e55e-477c-4b56-bc18-a06edc7cad31 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.155915 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e55e-477c-4b56-bc18-a06edc7cad31 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.156453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e55e-477c-4b56-bc18-a06edc7cad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.190024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e282e55e-477c-4b56-bc18-a06edc7cad31 None None] MFA Rules not processed for user `c72cf91771104ec5a2715077e3560196`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:25:20.191314 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e282e55e-477c-4b56-bc18-a06edc7cad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:25:20.267700 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1401/2753] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:25:20 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:25:20.272609 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fda05-e3cf-4f1c-bf73-5c3b9f357e90 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:20.341745 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fda05-e3cf-4f1c-bf73-5c3b9f357e90 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:20.347587 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869297c0-51e6-4e36-a569-d46376f69dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:20.348361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869297c0-51e6-4e36-a569-d46376f69dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.348684 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869297c0-51e6-4e36-a569-d46376f69dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.349079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869297c0-51e6-4e36-a569-d46376f69dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.350178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869297c0-51e6-4e36-a569-d46376f69dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:20.352261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869297c0-51e6-4e36-a569-d46376f69dc4 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:20.442623 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1353/2754] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:25:20 2021] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:25:20.447494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282e55e-477c-4b56-bc18-a06edc7cad31 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:20.460537 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282e55e-477c-4b56-bc18-a06edc7cad31 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:20.523216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5c641-58aa-4e5e-aeef-658a2ec91ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:20.523851 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c641-58aa-4e5e-aeef-658a2ec91ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.524138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c641-58aa-4e5e-aeef-658a2ec91ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.524470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c641-58aa-4e5e-aeef-658a2ec91ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.525207 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5c641-58aa-4e5e-aeef-658a2ec91ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:20.527220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5c641-58aa-4e5e-aeef-658a2ec91ec5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:20.620395 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1402/2755] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:25:20 2021] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:25:20.622495 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869297c0-51e6-4e36-a569-d46376f69dc4 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:20.633905 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869297c0-51e6-4e36-a569-d46376f69dc4 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:20.639239 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7161bef-90c4-4035-ba74-5daa5b46efde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:20.639919 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161bef-90c4-4035-ba74-5daa5b46efde admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.640193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161bef-90c4-4035-ba74-5daa5b46efde admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.640573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161bef-90c4-4035-ba74-5daa5b46efde admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.641350 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7161bef-90c4-4035-ba74-5daa5b46efde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:20.643790 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7161bef-90c4-4035-ba74-5daa5b46efde admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:20.663254 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1354/2756] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:25:20 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:25:20.667553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5c641-58aa-4e5e-aeef-658a2ec91ec5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:20.678577 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5c641-58aa-4e5e-aeef-658a2ec91ec5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:20.683455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9503-5679-4ef8-b719-c973893cab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:20.684366 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9503-5679-4ef8-b719-c973893cab13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.684633 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9503-5679-4ef8-b719-c973893cab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.684901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9503-5679-4ef8-b719-c973893cab13 admin admin] PATH_INFO: `/v3/projects/12d9545b6a8c4a0d9d467152ab64e9f1/users/b40ee4ce7de1461a84ee4614c37c6bda/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.703246 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9503-5679-4ef8-b719-c973893cab13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d9545b6a8c4a0d9d467152ab64e9f1, user_id=b40ee4ce7de1461a84ee4614c37c6bda, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:20.706499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9503-5679-4ef8-b719-c973893cab13 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:20.804292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1403/2757] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:25:20 2021] PUT /identity/v3/projects/12d9545b6a8c4a0d9d467152ab64e9f1/users/b40ee4ce7de1461a84ee4614c37c6bda/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:25:20.809596 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7161bef-90c4-4035-ba74-5daa5b46efde admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:20.821643 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7161bef-90c4-4035-ba74-5daa5b46efde admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:20.884114 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8027c-34a9-4c23-9d9a-4c38824339b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:20.884799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8027c-34a9-4c23-9d9a-4c38824339b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.885075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8027c-34a9-4c23-9d9a-4c38824339b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.885348 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8027c-34a9-4c23-9d9a-4c38824339b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.886096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8027c-34a9-4c23-9d9a-4c38824339b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:20.887757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8027c-34a9-4c23-9d9a-4c38824339b8 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:20.899313 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1355/2758] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:25:20 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:25:20.906139 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9503-5679-4ef8-b719-c973893cab13 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:20.922271 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9503-5679-4ef8-b719-c973893cab13 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:20.928365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:20.929289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.929664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.929830 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] PATH_INFO: `/v3/projects/12d9545b6a8c4a0d9d467152ab64e9f1/users/b40ee4ce7de1461a84ee4614c37c6bda/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.932055 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d9545b6a8c4a0d9d467152ab64e9f1, user_id=b40ee4ce7de1461a84ee4614c37c6bda, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:20.934808 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:20.946860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1404/2759] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:25:20 2021] PUT /identity/v3/projects/12d9545b6a8c4a0d9d467152ab64e9f1/users/b40ee4ce7de1461a84ee4614c37c6bda/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:25:20.958067 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84864080-3ccd-4035-9299-257cd65399c6 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:20.958351 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84864080-3ccd-4035-9299-257cd65399c6 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:20.958655 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84864080-3ccd-4035-9299-257cd65399c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:20.988751 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-84864080-3ccd-4035-9299-257cd65399c6 None None] MFA Rules not processed for user `b40ee4ce7de1461a84ee4614c37c6bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:25:20.990214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-84864080-3ccd-4035-9299-257cd65399c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:25:21.072369 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1356/2760] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:25:20 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:25:21.084216 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:21.086599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:25:21.183010 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1472ffa-5977-47ac-bd79-e4a64fb4a3ed admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:21.188438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e6b7-11df-4b3b-b1ad-44ce8d3fd749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:21.189950 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e6b7-11df-4b3b-b1ad-44ce8d3fd749 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:21.190297 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e6b7-11df-4b3b-b1ad-44ce8d3fd749 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:21.190703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e6b7-11df-4b3b-b1ad-44ce8d3fd749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:21.203359 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301e6b7-11df-4b3b-b1ad-44ce8d3fd749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:21.205102 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301e6b7-11df-4b3b-b1ad-44ce8d3fd749 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:21.216628 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1405/2761] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:25:21 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:25:21.412717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84864080-3ccd-4035-9299-257cd65399c6 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:25:21.423903 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84864080-3ccd-4035-9299-257cd65399c6 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:25:21.427761 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336b287-7593-4ca1-af98-43f48292bebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:25:21.428440 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336b287-7593-4ca1-af98-43f48292bebc service cinder] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:25:21.428717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336b287-7593-4ca1-af98-43f48292bebc service cinder] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:25:21.428990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336b287-7593-4ca1-af98-43f48292bebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:25:21.494742 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336b287-7593-4ca1-af98-43f48292bebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:25:21.496261 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336b287-7593-4ca1-af98-43f48292bebc service cinder] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:25:21.506577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1357/2762] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:25:21 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:26:11.835530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e6b7-11df-4b3b-b1ad-44ce8d3fd749 service cinder] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:11.971144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e6b7-11df-4b3b-b1ad-44ce8d3fd749 service cinder] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:11.975996 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:11.976883 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:11.977162 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:11.977437 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] PATH_INFO: `/v3/users/c72cf91771104ec5a2715077e3560196` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:11.978767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72cf91771104ec5a2715077e3560196)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:11.980743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:12.204205 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72cf91771104ec5a2715077e3560196'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:12.204922 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72cf91771104ec5a2715077e3560196'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:12.206479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72cf91771104ec5a2715077e3560196'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:12.316409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72cf91771104ec5a2715077e3560196'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:12.331870 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72cf91771104ec5a2715077e3560196'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:12.347885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1406/2763] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:26:11 2021] DELETE /identity/v3/users/c72cf91771104ec5a2715077e3560196 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:26:12.353242 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13528-7de0-4575-877b-023ee60be150 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:12.353947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13528-7de0-4575-877b-023ee60be150 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:12.353947 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13528-7de0-4575-877b-023ee60be150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:12.411786 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-93a13528-7de0-4575-877b-023ee60be150 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:12.413002 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-93a13528-7de0-4575-877b-023ee60be150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:12.482780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1358/2764] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:26:12.494036 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:12.495588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:12.589871 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442d2e9-4fa8-4e41-8b9b-786b639cd39e admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:12.594823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd67ee-b5e8-45ff-8432-a6db41df0439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:12.595657 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd67ee-b5e8-45ff-8432-a6db41df0439 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:12.595997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd67ee-b5e8-45ff-8432-a6db41df0439 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:12.596988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd67ee-b5e8-45ff-8432-a6db41df0439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:12.608140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd67ee-b5e8-45ff-8432-a6db41df0439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:12.609601 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd67ee-b5e8-45ff-8432-a6db41df0439 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:12.620310 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1407/2765] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:26:13.205193 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a13528-7de0-4575-877b-023ee60be150 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:13.207872 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-93a13528-7de0-4575-877b-023ee60be150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:13.233055 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a13528-7de0-4575-877b-023ee60be150 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:13.241285 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:13.242661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:13.243156 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:13.243659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] PATH_INFO: `/v3/projects/6c4e05b03cd941ea83ba240d14ae14cb` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:13.245999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4e05b03cd941ea83ba240d14ae14cb)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:13.250198 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:13.383830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4e05b03cd941ea83ba240d14ae14cb', 'request_id': 'req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.476567 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4e05b03cd941ea83ba240d14ae14cb', 'request_id': 'req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.484944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4e05b03cd941ea83ba240d14ae14cb', 'request_id': 'req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.496651 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] The token cache is being invalidate because project 6c4e05b03cd941ea83ba240d14ae14cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:26:13.497054 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.498258 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.499963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1359/2766] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:26:13 2021] DELETE /identity/v3/projects/6c4e05b03cd941ea83ba240d14ae14cb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:13.504182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd67ee-b5e8-45ff-8432-a6db41df0439 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:13.522342 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd67ee-b5e8-45ff-8432-a6db41df0439 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:13.604392 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:13.605411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:13.605732 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:13.606043 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] PATH_INFO: `/v3/users/b40ee4ce7de1461a84ee4614c37c6bda` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:13.607978 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40ee4ce7de1461a84ee4614c37c6bda)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:13.610195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:13.817826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40ee4ce7de1461a84ee4614c37c6bda'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.818662 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40ee4ce7de1461a84ee4614c37c6bda'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.819410 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40ee4ce7de1461a84ee4614c37c6bda'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.905121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40ee4ce7de1461a84ee4614c37c6bda'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.920618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a8c03f9c-0c6a-49e7-9c37-90fad0949aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40ee4ce7de1461a84ee4614c37c6bda'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:13.934822 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1408/2767] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:26:13 2021] DELETE /identity/v3/users/b40ee4ce7de1461a84ee4614c37c6bda => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:14.487365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:14.489424 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:14.511727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9cfb-b920-44c8-9e25-028d2ec8a9b9 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:14.595227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:14.596151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:14.596432 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:14.596709 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] PATH_INFO: `/v3/projects/12d9545b6a8c4a0d9d467152ab64e9f1` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:14.598068 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d9545b6a8c4a0d9d467152ab64e9f1)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:14.600079 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:14.736720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d9545b6a8c4a0d9d467152ab64e9f1', 'request_id': 'req-db7051a2-987d-4122-86fa-efed1f67b6c1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:14.852993 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d9545b6a8c4a0d9d467152ab64e9f1', 'request_id': 'req-db7051a2-987d-4122-86fa-efed1f67b6c1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:14.860416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d9545b6a8c4a0d9d467152ab64e9f1', 'request_id': 'req-db7051a2-987d-4122-86fa-efed1f67b6c1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:14.873026 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] The token cache is being invalidate because project 12d9545b6a8c4a0d9d467152ab64e9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:26:14.873344 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:14.874076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-db7051a2-987d-4122-86fa-efed1f67b6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:14.875781 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1360/2768] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:26:14 2021] DELETE /identity/v3/projects/12d9545b6a8c4a0d9d467152ab64e9f1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:26:14.883112 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514ef95-c1aa-481f-9069-a314d76a5a18 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:14.883671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514ef95-c1aa-481f-9069-a314d76a5a18 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:14.884199 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514ef95-c1aa-481f-9069-a314d76a5a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:14.951175 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e514ef95-c1aa-481f-9069-a314d76a5a18 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:14.952425 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e514ef95-c1aa-481f-9069-a314d76a5a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:15.046146 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1409/2769] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:15.055177 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2998-6c5c-4236-a5a9-4f79df8a8bf9 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:15.055614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2998-6c5c-4236-a5a9-4f79df8a8bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:15.055995 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2998-6c5c-4236-a5a9-4f79df8a8bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:15.077082 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-b9bc2998-6c5c-4236-a5a9-4f79df8a8bf9 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:15.078318 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b9bc2998-6c5c-4236-a5a9-4f79df8a8bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:15.086689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1361/2770] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:15.091957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514ef95-c1aa-481f-9069-a314d76a5a18 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:15.102686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514ef95-c1aa-481f-9069-a314d76a5a18 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:15.108073 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:15.108773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:15.109061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:15.109341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:15.110115 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:26:15.110426 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:15.112158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:15.127023 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1410/2771] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:26:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:26:15.132238 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2998-6c5c-4236-a5a9-4f79df8a8bf9 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:15.144528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2998-6c5c-4236-a5a9-4f79df8a8bf9 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:15.149646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0521ad5-7ea0-4462-9e1d-06926f31bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:15.150360 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521ad5-7ea0-4462-9e1d-06926f31bac6 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:15.150717 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521ad5-7ea0-4462-9e1d-06926f31bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:15.150967 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521ad5-7ea0-4462-9e1d-06926f31bac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:15.151701 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0521ad5-7ea0-4462-9e1d-06926f31bac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:15.153687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0521ad5-7ea0-4462-9e1d-06926f31bac6 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:15.266844 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1362/2772] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:26:15 2021] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:26:15.272148 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:15.283191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be9de0-1a13-4bb4-aa4a-968ecc60db5b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:15.361484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb731d-4ced-45b4-a16e-65222a2d54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:15.362687 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb731d-4ced-45b4-a16e-65222a2d54f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:15.363185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb731d-4ced-45b4-a16e-65222a2d54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:15.363685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb731d-4ced-45b4-a16e-65222a2d54f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:15.365000 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb731d-4ced-45b4-a16e-65222a2d54f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:15.368855 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb731d-4ced-45b4-a16e-65222a2d54f8 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:15.488475 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1411/2773] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:26:15 2021] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:26:15.493049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0521ad5-7ea0-4462-9e1d-06926f31bac6 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:15.509062 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0521ad5-7ea0-4462-9e1d-06926f31bac6 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:15.517128 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493e53-3b25-4ac8-aca5-cb892c6c1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:15.518048 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493e53-3b25-4ac8-aca5-cb892c6c1d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:15.518483 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493e53-3b25-4ac8-aca5-cb892c6c1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:15.518813 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493e53-3b25-4ac8-aca5-cb892c6c1d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:15.519828 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3493e53-3b25-4ac8-aca5-cb892c6c1d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:15.526122 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3493e53-3b25-4ac8-aca5-cb892c6c1d5a admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:15.543065 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1363/2774] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:15 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:15.552240 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb731d-4ced-45b4-a16e-65222a2d54f8 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:15.564957 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb731d-4ced-45b4-a16e-65222a2d54f8 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:15.570747 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c1d37-a00b-4b5d-a5e6-ab3cc51e575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:15.571551 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c1d37-a00b-4b5d-a5e6-ab3cc51e575a admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:15.571877 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c1d37-a00b-4b5d-a5e6-ab3cc51e575a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:15.572197 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c1d37-a00b-4b5d-a5e6-ab3cc51e575a admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:15.573028 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c1d37-a00b-4b5d-a5e6-ab3cc51e575a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:15.575228 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c1d37-a00b-4b5d-a5e6-ab3cc51e575a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:15.588147 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1412/2775] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:15 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:15.592808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493e53-3b25-4ac8-aca5-cb892c6c1d5a admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:15.606392 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493e53-3b25-4ac8-aca5-cb892c6c1d5a admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:15.611702 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab628-2cec-48c7-94f1-746668423e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:15.612528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab628-2cec-48c7-94f1-746668423e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:15.612812 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab628-2cec-48c7-94f1-746668423e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:15.613092 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab628-2cec-48c7-94f1-746668423e22 admin admin] PATH_INFO: `/v3/projects/9e062d62a1534c2e90db861f50559cb8/users/773fcc72da2a4955a8edd17580e2c216/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:15.631287 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aab628-2cec-48c7-94f1-746668423e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e062d62a1534c2e90db861f50559cb8, user_id=773fcc72da2a4955a8edd17580e2c216, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:15.634640 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aab628-2cec-48c7-94f1-746668423e22 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:15.752398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1364/2776] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:26:15 2021] PUT /identity/v3/projects/9e062d62a1534c2e90db861f50559cb8/users/773fcc72da2a4955a8edd17580e2c216/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:26:15.764398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dff7b-5f2d-421b-89fb-6f57a342ed42 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:15.764888 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dff7b-5f2d-421b-89fb-6f57a342ed42 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:15.765381 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dff7b-5f2d-421b-89fb-6f57a342ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:15.814536 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-1b6dff7b-5f2d-421b-89fb-6f57a342ed42 None None] MFA Rules not processed for user `773fcc72da2a4955a8edd17580e2c216`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:15.816664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1b6dff7b-5f2d-421b-89fb-6f57a342ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:15.948145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1413/2777] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:15 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:15.953176 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab628-2cec-48c7-94f1-746668423e22 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:16.028582 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab628-2cec-48c7-94f1-746668423e22 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:16.033422 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e98a-d07e-4cba-8164-fbabd87fdd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:16.034102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e98a-d07e-4cba-8164-fbabd87fdd8f admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:16.034443 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e98a-d07e-4cba-8164-fbabd87fdd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:16.034841 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256e98a-d07e-4cba-8164-fbabd87fdd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:16.035480 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256e98a-d07e-4cba-8164-fbabd87fdd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:16.037471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256e98a-d07e-4cba-8164-fbabd87fdd8f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:16.140429 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1365/2778] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:26:15 2021] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:26:16.145133 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dff7b-5f2d-421b-89fb-6f57a342ed42 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:16.157518 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dff7b-5f2d-421b-89fb-6f57a342ed42 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:16.225185 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4cd45-b5e4-4279-8a12-4215151b2ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:16.225778 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4cd45-b5e4-4279-8a12-4215151b2ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:16.226057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4cd45-b5e4-4279-8a12-4215151b2ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:16.226335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4cd45-b5e4-4279-8a12-4215151b2ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:16.227108 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4cd45-b5e4-4279-8a12-4215151b2ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:16.229083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4cd45-b5e4-4279-8a12-4215151b2ba5 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:16.322583 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1414/2779] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:26:16 2021] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:26:16.324834 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e98a-d07e-4cba-8164-fbabd87fdd8f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:16.343861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256e98a-d07e-4cba-8164-fbabd87fdd8f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:16.352127 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58cbbc-ec7e-4499-b655-83f125653b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:16.353315 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58cbbc-ec7e-4499-b655-83f125653b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:16.353823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58cbbc-ec7e-4499-b655-83f125653b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:16.354251 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58cbbc-ec7e-4499-b655-83f125653b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:16.355451 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58cbbc-ec7e-4499-b655-83f125653b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:16.359317 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58cbbc-ec7e-4499-b655-83f125653b8f admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:16.372924 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1366/2780] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:16 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:16.377415 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4cd45-b5e4-4279-8a12-4215151b2ba5 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:16.388570 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4cd45-b5e4-4279-8a12-4215151b2ba5 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:16.393689 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2a19-c8b4-4601-abc5-49f733af9676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:16.394878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2a19-c8b4-4601-abc5-49f733af9676 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:16.395179 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2a19-c8b4-4601-abc5-49f733af9676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:16.395530 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a2a19-c8b4-4601-abc5-49f733af9676 admin admin] PATH_INFO: `/v3/projects/fd048d1d39c44b9fa99c575fd865a58d/users/fbcf302c94d94df38de37adafc01dfba/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:16.414338 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a2a19-c8b4-4601-abc5-49f733af9676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd048d1d39c44b9fa99c575fd865a58d, user_id=fbcf302c94d94df38de37adafc01dfba, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:16.420553 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a2a19-c8b4-4601-abc5-49f733af9676 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:16.545200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1415/2781] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:26:16 2021] PUT /identity/v3/projects/fd048d1d39c44b9fa99c575fd865a58d/users/fbcf302c94d94df38de37adafc01dfba/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:16.549685 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58cbbc-ec7e-4499-b655-83f125653b8f admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:16.560060 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58cbbc-ec7e-4499-b655-83f125653b8f admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:16.622147 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce75b39-6b1c-41fe-84fe-02177a279ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:16.622878 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75b39-6b1c-41fe-84fe-02177a279ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:16.623158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75b39-6b1c-41fe-84fe-02177a279ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:16.623434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce75b39-6b1c-41fe-84fe-02177a279ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:16.624185 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce75b39-6b1c-41fe-84fe-02177a279ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:16.625800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce75b39-6b1c-41fe-84fe-02177a279ecd admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:16.636577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1367/2782] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:16 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:16.644275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2a19-c8b4-4601-abc5-49f733af9676 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:16.661231 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a2a19-c8b4-4601-abc5-49f733af9676 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:16.666438 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:16.667439 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:16.667688 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:16.667970 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] PATH_INFO: `/v3/projects/fd048d1d39c44b9fa99c575fd865a58d/users/fbcf302c94d94df38de37adafc01dfba/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:16.670144 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd048d1d39c44b9fa99c575fd865a58d, user_id=fbcf302c94d94df38de37adafc01dfba, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:16.672926 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:16.684420 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1416/2783] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:26:16 2021] PUT /identity/v3/projects/fd048d1d39c44b9fa99c575fd865a58d/users/fbcf302c94d94df38de37adafc01dfba/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:26:16.697821 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867437b0-1a19-4d90-a78f-64d7214c4e75 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:16.698330 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867437b0-1a19-4d90-a78f-64d7214c4e75 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:16.698735 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867437b0-1a19-4d90-a78f-64d7214c4e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:16.731606 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-867437b0-1a19-4d90-a78f-64d7214c4e75 None None] MFA Rules not processed for user `fbcf302c94d94df38de37adafc01dfba`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:16.732942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-867437b0-1a19-4d90-a78f-64d7214c4e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:16.807642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1368/2784] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:16 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:16.818017 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:16.819804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:16.888883 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a5de-3795-4667-9e55-6751e788bf5a admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:16.892923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35753766-47aa-4750-a93a-53f127a4c0a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:16.893589 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35753766-47aa-4750-a93a-53f127a4c0a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:16.893867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35753766-47aa-4750-a93a-53f127a4c0a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:16.894138 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35753766-47aa-4750-a93a-53f127a4c0a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:16.905255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35753766-47aa-4750-a93a-53f127a4c0a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:16.906764 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35753766-47aa-4750-a93a-53f127a4c0a2 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:16.918058 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1417/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:16 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:26:17.519493 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867437b0-1a19-4d90-a78f-64d7214c4e75 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:17.590621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867437b0-1a19-4d90-a78f-64d7214c4e75 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:17.601618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:17.604096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:17.604457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:17.604799 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] PATH_INFO: `/v3/users/773fcc72da2a4955a8edd17580e2c216` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:17.606325 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=773fcc72da2a4955a8edd17580e2c216)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:17.609374 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:17.842861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773fcc72da2a4955a8edd17580e2c216'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:17.843455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773fcc72da2a4955a8edd17580e2c216'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:17.844076 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773fcc72da2a4955a8edd17580e2c216'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:17.933334 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773fcc72da2a4955a8edd17580e2c216'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:17.946892 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773fcc72da2a4955a8edd17580e2c216'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:17.961485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1369/2786] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:26:17 2021] DELETE /identity/v3/users/773fcc72da2a4955a8edd17580e2c216 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:17.966922 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a88d-de08-4a8a-864a-27a4ad0e54ec None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:17.967498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a88d-de08-4a8a-864a-27a4ad0e54ec None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:17.967498 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a88d-de08-4a8a-864a-27a4ad0e54ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:17.986763 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2789a88d-de08-4a8a-864a-27a4ad0e54ec None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:17.987983 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2789a88d-de08-4a8a-864a-27a4ad0e54ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:18.055103 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1418/2787] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:18.070981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:18.072425 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:18.164467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf98961-6835-471b-b83f-61f44580f4dc admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:18.168335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac647d0-ecc3-4e84-86ae-99f75d25eddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:18.169001 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac647d0-ecc3-4e84-86ae-99f75d25eddf service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:18.169340 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac647d0-ecc3-4e84-86ae-99f75d25eddf service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:18.169616 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac647d0-ecc3-4e84-86ae-99f75d25eddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:18.179672 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac647d0-ecc3-4e84-86ae-99f75d25eddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:18.181133 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac647d0-ecc3-4e84-86ae-99f75d25eddf service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:18.192197 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1370/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:26:18.646020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a88d-de08-4a8a-864a-27a4ad0e54ec None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:18.647866 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2789a88d-de08-4a8a-864a-27a4ad0e54ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:18.661334 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a88d-de08-4a8a-864a-27a4ad0e54ec None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:18.667062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:18.668642 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:18.669140 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:18.669656 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] PATH_INFO: `/v3/projects/9e062d62a1534c2e90db861f50559cb8` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:18.672382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e062d62a1534c2e90db861f50559cb8)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:18.676249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:18.837534 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e062d62a1534c2e90db861f50559cb8', 'request_id': 'req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:18.927292 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e062d62a1534c2e90db861f50559cb8', 'request_id': 'req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:18.934757 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e062d62a1534c2e90db861f50559cb8', 'request_id': 'req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:18.948982 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] The token cache is being invalidate because project 9e062d62a1534c2e90db861f50559cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:26:18.949679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:18.950791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:18.952659 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1419/2789] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:26:18 2021] DELETE /identity/v3/projects/9e062d62a1534c2e90db861f50559cb8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:18.958023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac647d0-ecc3-4e84-86ae-99f75d25eddf service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:18.969474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac647d0-ecc3-4e84-86ae-99f75d25eddf service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:19.057016 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:19.058573 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:19.059101 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:19.059601 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] PATH_INFO: `/v3/users/fbcf302c94d94df38de37adafc01dfba` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:19.062494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbcf302c94d94df38de37adafc01dfba)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:19.066283 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:19.264467 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbcf302c94d94df38de37adafc01dfba'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:19.265275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbcf302c94d94df38de37adafc01dfba'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:19.266117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbcf302c94d94df38de37adafc01dfba'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:19.367618 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbcf302c94d94df38de37adafc01dfba'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:19.386075 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-80baa01d-cb46-4d1b-aab3-74f902e19837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbcf302c94d94df38de37adafc01dfba'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:19.401025 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1371/2790] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:26:18 2021] DELETE /identity/v3/users/fbcf302c94d94df38de37adafc01dfba => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:26:19.947295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:19.949248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:19.968767 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e08bd-fd3a-4d7a-aa8d-1256252bd0d1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:20.048328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:20.049391 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.049766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.050135 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] PATH_INFO: `/v3/projects/fd048d1d39c44b9fa99c575fd865a58d` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.051915 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd048d1d39c44b9fa99c575fd865a58d)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:20.054200 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:20.165184 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd048d1d39c44b9fa99c575fd865a58d', 'request_id': 'req-a87d2290-71bf-4376-ae2e-596fcba1b532'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:20.258823 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd048d1d39c44b9fa99c575fd865a58d', 'request_id': 'req-a87d2290-71bf-4376-ae2e-596fcba1b532'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:20.267089 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd048d1d39c44b9fa99c575fd865a58d', 'request_id': 'req-a87d2290-71bf-4376-ae2e-596fcba1b532'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:20.285729 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] The token cache is being invalidate because project fd048d1d39c44b9fa99c575fd865a58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:26:20.286193 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:20.287020 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-a87d2290-71bf-4376-ae2e-596fcba1b532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:20.288706 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1420/2791] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:26:19 2021] DELETE /identity/v3/projects/fd048d1d39c44b9fa99c575fd865a58d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:20.297859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481649-7e5d-48dd-bc8e-0a54e5bbb87a None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.298471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481649-7e5d-48dd-bc8e-0a54e5bbb87a None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.298471 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481649-7e5d-48dd-bc8e-0a54e5bbb87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.320659 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-14481649-7e5d-48dd-bc8e-0a54e5bbb87a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:20.321819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-14481649-7e5d-48dd-bc8e-0a54e5bbb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:20.392019 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1372/2792] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:20.401868 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e61e-f93c-454b-ad4d-639492ff6c30 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.402408 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e61e-f93c-454b-ad4d-639492ff6c30 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.402956 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e61e-f93c-454b-ad4d-639492ff6c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.435213 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9418e61e-f93c-454b-ad4d-639492ff6c30 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:20.437330 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9418e61e-f93c-454b-ad4d-639492ff6c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:20.451384 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1421/2793] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:20.456206 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481649-7e5d-48dd-bc8e-0a54e5bbb87a None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:20.467129 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481649-7e5d-48dd-bc8e-0a54e5bbb87a None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:20.472295 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:20.472981 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.473293 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.473642 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.474435 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:26:20.474770 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:20.476416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:20.489952 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1373/2794] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:26:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:26:20.494406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e61e-f93c-454b-ad4d-639492ff6c30 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:20.504990 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e61e-f93c-454b-ad4d-639492ff6c30 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:20.510114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2e6e4-7926-4554-a7a6-ff688bf70a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:20.510918 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e6e4-7926-4554-a7a6-ff688bf70a9d admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.511237 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e6e4-7926-4554-a7a6-ff688bf70a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.511554 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e6e4-7926-4554-a7a6-ff688bf70a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.512307 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2e6e4-7926-4554-a7a6-ff688bf70a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:20.514456 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2e6e4-7926-4554-a7a6-ff688bf70a9d admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:20.616295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1422/2795] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:26:20 2021] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:26:20.620819 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:20.632207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcaea6-0d6c-426d-be2e-157e1415f6d3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:20.716438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32cad5-a773-4567-8aa9-b59f5ebb8aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:20.717638 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cad5-a773-4567-8aa9-b59f5ebb8aeb admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.718117 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cad5-a773-4567-8aa9-b59f5ebb8aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.718648 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cad5-a773-4567-8aa9-b59f5ebb8aeb admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.719999 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32cad5-a773-4567-8aa9-b59f5ebb8aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:20.723614 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32cad5-a773-4567-8aa9-b59f5ebb8aeb admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:20.841906 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1374/2796] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:26:20 2021] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:26:20.846266 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2e6e4-7926-4554-a7a6-ff688bf70a9d admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:20.857911 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2e6e4-7926-4554-a7a6-ff688bf70a9d admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:20.862900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1328d3-fa6a-4e06-9ea8-b28de9e618fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:20.863582 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1328d3-fa6a-4e06-9ea8-b28de9e618fb admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.863864 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1328d3-fa6a-4e06-9ea8-b28de9e618fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.864249 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1328d3-fa6a-4e06-9ea8-b28de9e618fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.864907 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1328d3-fa6a-4e06-9ea8-b28de9e618fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:20.869316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1328d3-fa6a-4e06-9ea8-b28de9e618fb admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:20.879448 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1423/2797] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:20.883793 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32cad5-a773-4567-8aa9-b59f5ebb8aeb admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:20.894485 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32cad5-a773-4567-8aa9-b59f5ebb8aeb admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:20.899660 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9414145-b381-470f-b2fb-236f354c3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:20.900433 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9414145-b381-470f-b2fb-236f354c3091 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.900714 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9414145-b381-470f-b2fb-236f354c3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.900988 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9414145-b381-470f-b2fb-236f354c3091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.901745 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9414145-b381-470f-b2fb-236f354c3091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:20.903949 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9414145-b381-470f-b2fb-236f354c3091 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:20.917184 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1375/2798] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:26:20.922780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1328d3-fa6a-4e06-9ea8-b28de9e618fb admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:20.933371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1328d3-fa6a-4e06-9ea8-b28de9e618fb admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:20.938374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:20.939316 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:20.939599 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:20.939875 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] PATH_INFO: `/v3/projects/eed77ad242b64dd599a705fab96e7639/users/b96bab14e50a4516a19109e443a48788/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:20.957258 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed77ad242b64dd599a705fab96e7639, user_id=b96bab14e50a4516a19109e443a48788, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:20.960033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:21.053564 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1424/2799] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:26:20 2021] PUT /identity/v3/projects/eed77ad242b64dd599a705fab96e7639/users/b96bab14e50a4516a19109e443a48788/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:21.073042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3345-f5bf-4718-a9f0-7907009adef5 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:21.073415 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3345-f5bf-4718-a9f0-7907009adef5 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:21.073757 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c3345-f5bf-4718-a9f0-7907009adef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:21.104604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-674c3345-f5bf-4718-a9f0-7907009adef5 None None] MFA Rules not processed for user `b96bab14e50a4516a19109e443a48788`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:21.105861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-674c3345-f5bf-4718-a9f0-7907009adef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:21.183780 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1376/2800] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:21 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:21.195333 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:21.198180 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:21.290650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f6049-2747-46da-93a6-d2a02e4cdf36 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:21.294520 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1836cc8-11a8-4b39-a88a-75631b04bd5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:21.295214 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836cc8-11a8-4b39-a88a-75631b04bd5e service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:21.295522 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836cc8-11a8-4b39-a88a-75631b04bd5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:21.295791 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836cc8-11a8-4b39-a88a-75631b04bd5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:21.305114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1836cc8-11a8-4b39-a88a-75631b04bd5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:21.307594 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1836cc8-11a8-4b39-a88a-75631b04bd5e service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:21.316458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1425/2801] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:21 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:26:31.842946 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c3345-f5bf-4718-a9f0-7907009adef5 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:31.920476 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c3345-f5bf-4718-a9f0-7907009adef5 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:31.925896 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:31.926832 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:31.927107 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:31.927377 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] PATH_INFO: `/v3/users/b96bab14e50a4516a19109e443a48788` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:31.928716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96bab14e50a4516a19109e443a48788)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:31.930716 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:32.174732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96bab14e50a4516a19109e443a48788'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:32.174732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96bab14e50a4516a19109e443a48788'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:32.174732 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96bab14e50a4516a19109e443a48788'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:32.269883 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96bab14e50a4516a19109e443a48788'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:32.284696 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96bab14e50a4516a19109e443a48788'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:32.298909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1377/2802] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:26:31 2021] DELETE /identity/v3/users/b96bab14e50a4516a19109e443a48788 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:32.304204 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea620e-e009-4817-8e51-9df6fc61a79a None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:32.304819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea620e-e009-4817-8e51-9df6fc61a79a None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:32.304819 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea620e-e009-4817-8e51-9df6fc61a79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:32.332131 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-ccea620e-e009-4817-8e51-9df6fc61a79a None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:32.334255 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ccea620e-e009-4817-8e51-9df6fc61a79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:32.434748 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1426/2803] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:26:32.445151 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:32.446942 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:32.519954 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4168240-ca98-4da2-9c8b-bd9e05855d0e admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:32.526272 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa55106-8215-486c-aabb-224d99744687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:32.527427 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa55106-8215-486c-aabb-224d99744687 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:32.528544 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa55106-8215-486c-aabb-224d99744687 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:32.529045 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa55106-8215-486c-aabb-224d99744687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:32.546359 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa55106-8215-486c-aabb-224d99744687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:32.549361 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa55106-8215-486c-aabb-224d99744687 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:32.567939 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1378/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:26:33.083852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea620e-e009-4817-8e51-9df6fc61a79a None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:33.085631 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ccea620e-e009-4817-8e51-9df6fc61a79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:33.099084 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea620e-e009-4817-8e51-9df6fc61a79a None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:33.104804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:33.106222 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:33.106493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:33.106820 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] PATH_INFO: `/v3/projects/eed77ad242b64dd599a705fab96e7639` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:33.112562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed77ad242b64dd599a705fab96e7639)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:33.115209 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:33.255280 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed77ad242b64dd599a705fab96e7639', 'request_id': 'req-d5030a2a-754b-47df-83bd-023f6aac93dd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:33.373300 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed77ad242b64dd599a705fab96e7639', 'request_id': 'req-d5030a2a-754b-47df-83bd-023f6aac93dd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:33.385937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed77ad242b64dd599a705fab96e7639', 'request_id': 'req-d5030a2a-754b-47df-83bd-023f6aac93dd'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:33.408405 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] The token cache is being invalidate because project eed77ad242b64dd599a705fab96e7639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:26:33.408973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:33.410177 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-d5030a2a-754b-47df-83bd-023f6aac93dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:33.413061 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1427/2805] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:26:33 2021] DELETE /identity/v3/projects/eed77ad242b64dd599a705fab96e7639 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:26:33.422580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c64911-8a40-4b91-8e33-75e192eeb705 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:33.423457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c64911-8a40-4b91-8e33-75e192eeb705 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:33.423457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c64911-8a40-4b91-8e33-75e192eeb705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:33.452100 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-c3c64911-8a40-4b91-8e33-75e192eeb705 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:33.453494 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-c3c64911-8a40-4b91-8e33-75e192eeb705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:33.559621 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1379/2806] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:26:33.568033 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78a373-252f-4dec-a492-3d14e1e81f51 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:33.573018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78a373-252f-4dec-a492-3d14e1e81f51 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:33.573018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78a373-252f-4dec-a492-3d14e1e81f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:33.595867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-2c78a373-252f-4dec-a492-3d14e1e81f51 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:33.597110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-2c78a373-252f-4dec-a492-3d14e1e81f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:33.607484 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1428/2807] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:33.612854 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c64911-8a40-4b91-8e33-75e192eeb705 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:33.623843 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c64911-8a40-4b91-8e33-75e192eeb705 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:33.630032 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:33.630808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:33.631132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:33.631478 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:33.632530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:26:33.632909 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:33.634728 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:33.648035 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1380/2808] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:26:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 11 17:26:33.655129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78a373-252f-4dec-a492-3d14e1e81f51 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:33.665661 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78a373-252f-4dec-a492-3d14e1e81f51 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:33.671658 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b964d5-c93d-4c5f-a708-e889f074d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:33.672343 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b964d5-c93d-4c5f-a708-e889f074d304 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:33.672622 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b964d5-c93d-4c5f-a708-e889f074d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:33.672894 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b964d5-c93d-4c5f-a708-e889f074d304 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:33.673671 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b964d5-c93d-4c5f-a708-e889f074d304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:33.675695 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b964d5-c93d-4c5f-a708-e889f074d304 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:33.774121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1429/2809] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:26:33 2021] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:26:33.779365 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:33.790824 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da3a79-acdd-40f1-acc3-0c6fae93bf96 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:33.853221 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4dfe4-8e8c-4f9d-8521-151442f2c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:33.853944 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4dfe4-8e8c-4f9d-8521-151442f2c0df admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:33.854222 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4dfe4-8e8c-4f9d-8521-151442f2c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:33.854493 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4dfe4-8e8c-4f9d-8521-151442f2c0df admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:33.855264 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4dfe4-8e8c-4f9d-8521-151442f2c0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:33.857416 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4dfe4-8e8c-4f9d-8521-151442f2c0df admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:33.956764 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1381/2810] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:26:33 2021] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:26:33.963693 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b964d5-c93d-4c5f-a708-e889f074d304 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:33.983253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b964d5-c93d-4c5f-a708-e889f074d304 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:33.991686 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380779d-4dbe-4fe0-889e-fbc73434fba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:33.992821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380779d-4dbe-4fe0-889e-fbc73434fba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:33.993442 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380779d-4dbe-4fe0-889e-fbc73434fba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:33.993923 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380779d-4dbe-4fe0-889e-fbc73434fba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:33.995275 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380779d-4dbe-4fe0-889e-fbc73434fba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:33.998388 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380779d-4dbe-4fe0-889e-fbc73434fba4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:34.019857 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1430/2811] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:33 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:34.024051 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4dfe4-8e8c-4f9d-8521-151442f2c0df admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:34.035523 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4dfe4-8e8c-4f9d-8521-151442f2c0df admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:34.040510 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6540bd6-acb0-445c-b9d9-4f3064fc9084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:34.041194 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540bd6-acb0-445c-b9d9-4f3064fc9084 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:34.041479 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540bd6-acb0-445c-b9d9-4f3064fc9084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:34.041760 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540bd6-acb0-445c-b9d9-4f3064fc9084 admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:34.042502 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6540bd6-acb0-445c-b9d9-4f3064fc9084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:34.044158 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6540bd6-acb0-445c-b9d9-4f3064fc9084 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:34.054975 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1382/2812] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:26:34.060110 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380779d-4dbe-4fe0-889e-fbc73434fba4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:34.070445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380779d-4dbe-4fe0-889e-fbc73434fba4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:34.075988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:34.076887 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:34.077167 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:34.077450 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] PATH_INFO: `/v3/projects/ce126ca5a78d4828a1758164b186cb65/users/6fe8e7e132d34f0cb50ab808b364c699/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:34.094900 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce126ca5a78d4828a1758164b186cb65, user_id=6fe8e7e132d34f0cb50ab808b364c699, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:34.097609 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:34.202024 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1431/2813] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:26:34 2021] PUT /identity/v3/projects/ce126ca5a78d4828a1758164b186cb65/users/6fe8e7e132d34f0cb50ab808b364c699/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:26:34.213434 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae07ad-a928-4f3a-ac14-d364f1e46494 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:34.213754 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae07ad-a928-4f3a-ac14-d364f1e46494 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:34.213894 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae07ad-a928-4f3a-ac14-d364f1e46494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:34.244357 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-bcae07ad-a928-4f3a-ac14-d364f1e46494 None None] MFA Rules not processed for user `6fe8e7e132d34f0cb50ab808b364c699`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:34.245594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-bcae07ad-a928-4f3a-ac14-d364f1e46494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:34.312888 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1383/2814] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:34 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:34.323752 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:34.326111 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:34.385486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc67f-4154-4949-920e-aadff652d334 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:34.389826 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19197e67-18da-40da-aefe-7f4e9b93a9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b88bc12e78894bdbaf79d148c3dd2e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:34.390494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197e67-18da-40da-aefe-7f4e9b93a9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:34.390811 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197e67-18da-40da-aefe-7f4e9b93a9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:34.391083 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197e67-18da-40da-aefe-7f4e9b93a9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:34.400288 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19197e67-18da-40da-aefe-7f4e9b93a9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:34.401742 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19197e67-18da-40da-aefe-7f4e9b93a9e2 service cinder] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:34.419852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1432/2815] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:34 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:26:34.445667 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae07ad-a928-4f3a-ac14-d364f1e46494 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:34.515823 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae07ad-a928-4f3a-ac14-d364f1e46494 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:34.520597 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:34.521505 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:34.521767 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:34.522038 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] PATH_INFO: `/v3/users/6fe8e7e132d34f0cb50ab808b364c699` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:34.523304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe8e7e132d34f0cb50ab808b364c699)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:34.525260 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:34.757976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe8e7e132d34f0cb50ab808b364c699'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:34.758741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe8e7e132d34f0cb50ab808b364c699'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:34.759355 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe8e7e132d34f0cb50ab808b364c699'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:34.852178 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe8e7e132d34f0cb50ab808b364c699'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:34.865829 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe8e7e132d34f0cb50ab808b364c699'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:34.878634 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1384/2816] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:26:34 2021] DELETE /identity/v3/users/6fe8e7e132d34f0cb50ab808b364c699 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:34.883579 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65041c6-2d8d-4592-b561-9c9cb1aa80bb None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:34.883862 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65041c6-2d8d-4592-b561-9c9cb1aa80bb None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:34.884137 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65041c6-2d8d-4592-b561-9c9cb1aa80bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:34.901991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c65041c6-2d8d-4592-b561-9c9cb1aa80bb None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:34.903738 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c65041c6-2d8d-4592-b561-9c9cb1aa80bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:34.967406 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1433/2817] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:34.981354 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:34.982902 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:35.044189 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85088c79-fd89-4c1a-b5bb-eb1288453043 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:35.047916 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d267657-e255-4b17-8d5f-975fe2f9b20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:35.048580 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267657-e255-4b17-8d5f-975fe2f9b20b service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:35.048859 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267657-e255-4b17-8d5f-975fe2f9b20b service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:35.049130 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d267657-e255-4b17-8d5f-975fe2f9b20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:35.059006 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d267657-e255-4b17-8d5f-975fe2f9b20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:35.060468 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d267657-e255-4b17-8d5f-975fe2f9b20b service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:35.071137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1385/2818] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:26:35.522155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65041c6-2d8d-4592-b561-9c9cb1aa80bb None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:35.524418 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c65041c6-2d8d-4592-b561-9c9cb1aa80bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:35.540145 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65041c6-2d8d-4592-b561-9c9cb1aa80bb None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:35.545409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:35.546340 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:35.546780 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:35.552486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] PATH_INFO: `/v3/projects/ce126ca5a78d4828a1758164b186cb65` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:35.553009 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce126ca5a78d4828a1758164b186cb65)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:35.556042 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:35.711901 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce126ca5a78d4828a1758164b186cb65', 'request_id': 'req-9f05f6fc-61e8-4a97-a031-7dcc17925128'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:35.800641 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce126ca5a78d4828a1758164b186cb65', 'request_id': 'req-9f05f6fc-61e8-4a97-a031-7dcc17925128'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:35.807105 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce126ca5a78d4828a1758164b186cb65', 'request_id': 'req-9f05f6fc-61e8-4a97-a031-7dcc17925128'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:35.819904 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] The token cache is being invalidate because project ce126ca5a78d4828a1758164b186cb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:26:35.820172 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:35.820860 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-9f05f6fc-61e8-4a97-a031-7dcc17925128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:26:35.822449 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1434/2819] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:26:35 2021] DELETE /identity/v3/projects/ce126ca5a78d4828a1758164b186cb65 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:35.830087 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0188b6e-16b4-4fe5-a0ef-2f91538d15cf None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:35.830884 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0188b6e-16b4-4fe5-a0ef-2f91538d15cf None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:35.831049 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0188b6e-16b4-4fe5-a0ef-2f91538d15cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:35.857706 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-d0188b6e-16b4-4fe5-a0ef-2f91538d15cf None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:35.859094 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-d0188b6e-16b4-4fe5-a0ef-2f91538d15cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:35.942230 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1386/2820] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:35.952325 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80226c3-c45f-4367-97ee-d63b777c6ada None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:35.952603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80226c3-c45f-4367-97ee-d63b777c6ada None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:35.952878 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80226c3-c45f-4367-97ee-d63b777c6ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:35.972065 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-c80226c3-c45f-4367-97ee-d63b777c6ada None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:35.973273 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-c80226c3-c45f-4367-97ee-d63b777c6ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:35.981882 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1435/2821] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:35.986491 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0188b6e-16b4-4fe5-a0ef-2f91538d15cf None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:35.997552 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0188b6e-16b4-4fe5-a0ef-2f91538d15cf None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:36.002390 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:36.003089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:36.003366 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:36.003645 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] PATH_INFO: `/v3/domains` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:36.004382 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79381) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 11 17:26:36.004679 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:36.006282 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:36.019046 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1387/2822] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Nov 11 17:26:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 11 17:26:36.023611 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80226c3-c45f-4367-97ee-d63b777c6ada None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:36.034580 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80226c3-c45f-4367-97ee-d63b777c6ada None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:36.039598 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be274d-5996-4c60-a517-8f2e769a8344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:36.040404 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be274d-5996-4c60-a517-8f2e769a8344 admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:36.040817 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be274d-5996-4c60-a517-8f2e769a8344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:36.041195 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be274d-5996-4c60-a517-8f2e769a8344 admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:36.042015 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be274d-5996-4c60-a517-8f2e769a8344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:36.044665 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be274d-5996-4c60-a517-8f2e769a8344 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:36.174455 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1436/2823] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:26:36 2021] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:26:36.178938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:36.193619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb69b1-5c91-4f37-b534-b591fc011658 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:36.264960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ab139-7598-4a7c-a505-9d1998b9de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:36.265646 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab139-7598-4a7c-a505-9d1998b9de82 admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:36.265925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab139-7598-4a7c-a505-9d1998b9de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:36.266199 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ab139-7598-4a7c-a505-9d1998b9de82 admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:36.266976 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ab139-7598-4a7c-a505-9d1998b9de82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:36.268941 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ab139-7598-4a7c-a505-9d1998b9de82 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:36.367503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1388/2824] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:26:36 2021] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 11 17:26:36.372319 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be274d-5996-4c60-a517-8f2e769a8344 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:36.383729 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be274d-5996-4c60-a517-8f2e769a8344 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:36.388917 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61070a-5db1-4a2b-9cf4-2d3e13e7d0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:36.389603 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61070a-5db1-4a2b-9cf4-2d3e13e7d0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:36.389884 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61070a-5db1-4a2b-9cf4-2d3e13e7d0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:36.390176 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61070a-5db1-4a2b-9cf4-2d3e13e7d0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:36.390938 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61070a-5db1-4a2b-9cf4-2d3e13e7d0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:36.392569 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61070a-5db1-4a2b-9cf4-2d3e13e7d0cf admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:36.405552 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1437/2825] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:36.420033 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ab139-7598-4a7c-a505-9d1998b9de82 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:36.433126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ab139-7598-4a7c-a505-9d1998b9de82 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:36.438103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7868a4-cc03-43f1-bbad-1b909a08ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:36.438960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7868a4-cc03-43f1-bbad-1b909a08ae1b admin admin] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:36.439216 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7868a4-cc03-43f1-bbad-1b909a08ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:36.439486 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7868a4-cc03-43f1-bbad-1b909a08ae1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:36.440227 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7868a4-cc03-43f1-bbad-1b909a08ae1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:36.441830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7868a4-cc03-43f1-bbad-1b909a08ae1b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:36.452979 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1389/2826] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:36.459447 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61070a-5db1-4a2b-9cf4-2d3e13e7d0cf admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:36.473238 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61070a-5db1-4a2b-9cf4-2d3e13e7d0cf admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:36.481630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:36.483278 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:36.483664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:36.484263 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] PATH_INFO: `/v3/projects/0918d6b635a04c89ae9c7253d1a3901f/users/a2a03a6f59274cd4aac3297e25ecd9be/roles/185d4a889ab64e4d84c11737116af86a` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:36.502389 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0918d6b635a04c89ae9c7253d1a3901f, user_id=a2a03a6f59274cd4aac3297e25ecd9be, role_id=185d4a889ab64e4d84c11737116af86a)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:36.505129 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:36.629558 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1438/2827] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:26:36 2021] PUT /identity/v3/projects/0918d6b635a04c89ae9c7253d1a3901f/users/a2a03a6f59274cd4aac3297e25ecd9be/roles/185d4a889ab64e4d84c11737116af86a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:36.635503 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194c55-1512-4920-a541-602e1f5befe2 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:36.642138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194c55-1512-4920-a541-602e1f5befe2 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:36.642138 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a194c55-1512-4920-a541-602e1f5befe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:36.654782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-8a194c55-1512-4920-a541-602e1f5befe2 None None] MFA Rules not processed for user `2ae4cc8e79cb47cc8c55c2d79c2c09d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:36.656096 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-8a194c55-1512-4920-a541-602e1f5befe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:36.722418 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1390/2828] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:36.732500 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:36.735505 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:36.822461 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def2cad-9414-4618-9630-df0387674cd6 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:36.827181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e812d-ea2a-4203-baef-737add714552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:36.827843 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e812d-ea2a-4203-baef-737add714552 service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:36.828124 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e812d-ea2a-4203-baef-737add714552 service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:36.828398 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e812d-ea2a-4203-baef-737add714552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:36.838451 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e812d-ea2a-4203-baef-737add714552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:36.846032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e812d-ea2a-4203-baef-737add714552 service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:36.851586 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1439/2829] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:26:43.271620 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb69a-093d-4d31-91ff-d197f1e25491 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:43.272336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb69a-093d-4d31-91ff-d197f1e25491 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:43.272336 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb69a-093d-4d31-91ff-d197f1e25491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:43.302367 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-e26bb69a-093d-4d31-91ff-d197f1e25491 None None] MFA Rules not processed for user `a2a03a6f59274cd4aac3297e25ecd9be`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:43.303632 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-e26bb69a-093d-4d31-91ff-d197f1e25491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:43.398700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1391/2830] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:43 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:43.400457 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e812d-ea2a-4203-baef-737add714552 service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:43.417152 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e812d-ea2a-4203-baef-737add714552 service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:43.422867 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e59c8-2b51-4d59-9021-53e2cc509b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:43.423772 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e59c8-2b51-4d59-9021-53e2cc509b1b admin admin] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:43.424048 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e59c8-2b51-4d59-9021-53e2cc509b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:43.436277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e59c8-2b51-4d59-9021-53e2cc509b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:43.436277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e59c8-2b51-4d59-9021-53e2cc509b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:43.436277 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e59c8-2b51-4d59-9021-53e2cc509b1b admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:43.602453 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1440/2831] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Nov 11 17:26:43 2021] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:26:43.608549 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bb69a-093d-4d31-91ff-d197f1e25491 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:43.634248 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bb69a-093d-4d31-91ff-d197f1e25491 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:43.739528 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ef9c-7d95-4350-b47d-4f87675f9e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:43.740297 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ef9c-7d95-4350-b47d-4f87675f9e6b admin admin] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:43.740577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ef9c-7d95-4350-b47d-4f87675f9e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:43.740850 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434ef9c-7d95-4350-b47d-4f87675f9e6b admin admin] PATH_INFO: `/v3/users` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:43.741569 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434ef9c-7d95-4350-b47d-4f87675f9e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:43.744518 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434ef9c-7d95-4350-b47d-4f87675f9e6b admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:43.834619 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1392/2832] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Nov 11 17:26:43 2021] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 11 17:26:43.841158 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e59c8-2b51-4d59-9021-53e2cc509b1b admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:43.861182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e59c8-2b51-4d59-9021-53e2cc509b1b admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:43.869499 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c033-851a-4fc0-b0ae-7e8e3241ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:43.870906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c033-851a-4fc0-b0ae-7e8e3241ae95 admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:43.871653 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c033-851a-4fc0-b0ae-7e8e3241ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:43.874682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c033-851a-4fc0-b0ae-7e8e3241ae95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:43.874682 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c033-851a-4fc0-b0ae-7e8e3241ae95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:43.876973 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c033-851a-4fc0-b0ae-7e8e3241ae95 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:43.897953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1441/2833] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:43 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 11 17:26:43.904575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ef9c-7d95-4350-b47d-4f87675f9e6b admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:43.923356 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434ef9c-7d95-4350-b47d-4f87675f9e6b admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:43.933149 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0260c0-3315-4350-a0bf-37317a2da60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:43.935037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0260c0-3315-4350-a0bf-37317a2da60c admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:43.935637 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0260c0-3315-4350-a0bf-37317a2da60c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:43.936137 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0260c0-3315-4350-a0bf-37317a2da60c admin admin] PATH_INFO: `/v3/projects/3130da64ca90454cbfe95cf315e224fb/users/e34d4005a5d64755ae431a3867c52e45/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:43.967012 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0260c0-3315-4350-a0bf-37317a2da60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3130da64ca90454cbfe95cf315e224fb, user_id=e34d4005a5d64755ae431a3867c52e45, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:43.972798 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0260c0-3315-4350-a0bf-37317a2da60c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:44.064023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1393/2834] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:26:43 2021] PUT /identity/v3/projects/3130da64ca90454cbfe95cf315e224fb/users/e34d4005a5d64755ae431a3867c52e45/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:44.064972 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c033-851a-4fc0-b0ae-7e8e3241ae95 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:44.077707 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c033-851a-4fc0-b0ae-7e8e3241ae95 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:44.216267 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f75fc2-1e53-41b3-8ceb-87780b50f4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:44.217664 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75fc2-1e53-41b3-8ceb-87780b50f4db admin admin] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:44.218326 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75fc2-1e53-41b3-8ceb-87780b50f4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:44.218967 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75fc2-1e53-41b3-8ceb-87780b50f4db admin admin] PATH_INFO: `/v3/roles` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:44.220494 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f75fc2-1e53-41b3-8ceb-87780b50f4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:44.223802 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f75fc2-1e53-41b3-8ceb-87780b50f4db admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:44.249643 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1442/2835] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Nov 11 17:26:44 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 11 17:26:44.252964 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0260c0-3315-4350-a0bf-37317a2da60c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:44.274279 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0260c0-3315-4350-a0bf-37317a2da60c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:44.282368 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:44.283335 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] REQUEST_METHOD: `PUT` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:44.283842 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:44.284301 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] PATH_INFO: `/v3/projects/3130da64ca90454cbfe95cf315e224fb/users/e34d4005a5d64755ae431a3867c52e45/roles/b515f1065b7b4995a64817150cd03ce8` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:44.286830 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3130da64ca90454cbfe95cf315e224fb, user_id=e34d4005a5d64755ae431a3867c52e45, role_id=b515f1065b7b4995a64817150cd03ce8)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:44.290030 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:44.309687 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1394/2836] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Nov 11 17:26:44 2021] PUT /identity/v3/projects/3130da64ca90454cbfe95cf315e224fb/users/e34d4005a5d64755ae431a3867c52e45/roles/b515f1065b7b4995a64817150cd03ce8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:26:51.522121 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2391-d508-4059-a0c3-bdec1a796952 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:51.522734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2391-d508-4059-a0c3-bdec1a796952 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:51.522734 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2391-d508-4059-a0c3-bdec1a796952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:51.557468 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-aaef2391-d508-4059-a0c3-bdec1a796952 None None] MFA Rules not processed for user `e34d4005a5d64755ae431a3867c52e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:51.558839 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-aaef2391-d508-4059-a0c3-bdec1a796952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:51.689479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1443/2837] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:26:51 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:51.712207 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:51.715855 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:51.816346 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39ddc2-0680-4015-a492-1e635a39948d admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:51.820960 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a061423c1f646b8892d646979f84f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:51.821530 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:51.821951 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:51.822273 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:51.948604 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:51.950157 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:51.961037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1395/2838] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:26:51 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:26:52.250386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41e89-d2c6-4ff2-b502-037613187377 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:52.250766 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41e89-d2c6-4ff2-b502-037613187377 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:52.250988 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee41e89-d2c6-4ff2-b502-037613187377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:52.286953 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-9ee41e89-d2c6-4ff2-b502-037613187377 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:26:52.289743 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9ee41e89-d2c6-4ff2-b502-037613187377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:52.435588 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1444/2839] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:26:52 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:26:52.633990 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:26:52.636982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:26:52.751401 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee877bf6-2bed-443b-9f1a-40c7d12b6d0f service glance] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:26:52.757800 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:26:52.758808 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:26:52.759181 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:26:52.759568 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:26:52.770398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:26:52.772112 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:26:52.781869 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1396/2840] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:26:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:27:00.634608 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee41e89-d2c6-4ff2-b502-037613187377 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:27:00.636382 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9ee41e89-d2c6-4ff2-b502-037613187377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:00.758208 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee41e89-d2c6-4ff2-b502-037613187377 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:27:00.768493 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:27:00.769650 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:27:00.770114 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:27:00.770773 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:27:00.774407 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:00.798977 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:27:00.802018 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:27:00.817194 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1445/2841] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:27:00 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:27:00.982496 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:27:00.984861 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:01.126265 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f390a72-81cc-4c26-a3b8-f484d1e40107 service swift] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:27:01.138105 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff52455-4725-4ab4-a2f1-da5bbeaaaaf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db055fddc41c4eb0ba1c3b410e1e8e03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:27:01.139047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff52455-4725-4ab4-a2f1-da5bbeaaaaf7 service placement] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:27:01.139431 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff52455-4725-4ab4-a2f1-da5bbeaaaaf7 service placement] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:27:01.139854 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff52455-4725-4ab4-a2f1-da5bbeaaaaf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:27:01.142441 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4ff52455-4725-4ab4-a2f1-da5bbeaaaaf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:01.163661 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff52455-4725-4ab4-a2f1-da5bbeaaaaf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:27:01.167102 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff52455-4725-4ab4-a2f1-da5bbeaaaaf7 service placement] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:27:01.190024 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1397/2842] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:27:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:27:01.735059 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:27:01.739463 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:01.932486 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aa2e5-2aab-4437-a127-cc4c54c5d45e service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:27:01.959913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e059c-e879-45c7-8ee7-64c03cd90317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:27:01.959913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e059c-e879-45c7-8ee7-64c03cd90317 service nova] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:27:01.959913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e059c-e879-45c7-8ee7-64c03cd90317 service nova] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:27:01.959913 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e059c-e879-45c7-8ee7-64c03cd90317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:27:01.962335 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ff5e059c-e879-45c7-8ee7-64c03cd90317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:01.982411 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e059c-e879-45c7-8ee7-64c03cd90317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:27:01.985681 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e059c-e879-45c7-8ee7-64c03cd90317 service nova] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:27:02.006821 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1446/2843] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:27:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:27:05.260741 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475d71-77af-41c5-b326-05a727d1b257 None None] REQUEST_METHOD: `POST` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:27:05.261345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475d71-77af-41c5-b326-05a727d1b257 None None] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:27:05.261345 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475d71-77af-41c5-b326-05a727d1b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:27:05.280594 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.auth.core [None req-68475d71-77af-41c5-b326-05a727d1b257 None None] MFA Rules not processed for user `a2a03a6f59274cd4aac3297e25ecd9be`. Rule list: `[]` (Enabled: `True`). {{(pid=79381) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:27:05.282456 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-68475d71-77af-41c5-b326-05a727d1b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:05.294989 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1398/2844] 10.222.0.16 () {58 vars in 957 bytes} [Thu Nov 11 17:27:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:27:09.193469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081cfc-faf6-402a-83a3-62ace2b8c087 None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:27:09.194052 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081cfc-faf6-402a-83a3-62ace2b8c087 None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:27:09.194155 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081cfc-faf6-402a-83a3-62ace2b8c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:27:09.215341 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-bc081cfc-faf6-402a-83a3-62ace2b8c087 None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:27:09.216997 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-bc081cfc-faf6-402a-83a3-62ace2b8c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:09.225470 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1447/2845] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Nov 11 17:27:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 11 17:27:09.245700 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68475d71-77af-41c5-b326-05a727d1b257 None None] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:27:09.260635 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68475d71-77af-41c5-b326-05a727d1b257 None None] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:27:09.265925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba8e1f-f76b-4fe4-a4ce-dcb9788df43e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:27:09.266607 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8e1f-f76b-4fe4-a4ce-dcb9788df43e service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:27:09.266992 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8e1f-f76b-4fe4-a4ce-dcb9788df43e service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:27:09.267173 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8e1f-f76b-4fe4-a4ce-dcb9788df43e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:27:09.276708 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba8e1f-f76b-4fe4-a4ce-dcb9788df43e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:27:09.278252 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba8e1f-f76b-4fe4-a4ce-dcb9788df43e service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:27:09.287895 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1399/2846] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:27:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 11 17:27:39.502929 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc081cfc-faf6-402a-83a3-62ace2b8c087 None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:27:39.514127 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc081cfc-faf6-402a-83a3-62ace2b8c087 None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:27:39.517937 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:27:39.518621 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:27:39.518906 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:27:39.519181 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:27:39.529737 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:27:39.531248 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:27:39.542365 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1448/2847] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:27:39 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:27:45.840915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba8e1f-f76b-4fe4-a4ce-dcb9788df43e service swift] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:27:45.863275 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba8e1f-f76b-4fe4-a4ce-dcb9788df43e service swift] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:27:45.864920 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0941777cfcbf4532be31ca001ced8aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:27:45.865577 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:27:45.866047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:27:45.866699 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:27:45.868963 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:27:45.896893 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:27:45.899111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:27:45.922630 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1400/2848] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:27:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:28:22.166295 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:28:22.168098 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:28:22.211006 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c03b8-6398-41aa-9cb5-acfdd2926eae service neutron] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:28:22.216679 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15450839-205f-4618-9a2e-d06a800bf93f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db055fddc41c4eb0ba1c3b410e1e8e03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:28:22.217469 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450839-205f-4618-9a2e-d06a800bf93f service placement] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:28:22.217790 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450839-205f-4618-9a2e-d06a800bf93f service placement] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:28:22.218106 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450839-205f-4618-9a2e-d06a800bf93f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:28:22.220371 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-15450839-205f-4618-9a2e-d06a800bf93f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:28:22.233540 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15450839-205f-4618-9a2e-d06a800bf93f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:28:22.235491 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15450839-205f-4618-9a2e-d06a800bf93f service placement] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:28:22.248062 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1449/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:28:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 11 17:28:51.812188 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:28:51.827498 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157ffc-3ac1-4c55-8583-69fc9d593d68 service nova] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:28:51.833509 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872474833e2f49c9a9ceccef8914e2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:28:51.834537 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:28:51.838958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:28:51.838958 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:28:51.844398 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:28:51.969982 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:28:51.972578 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:28:51.994225 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1401/2850] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:28:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 11 17:29:00.544459 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748f8d0-1a82-4409-b9b0-8e75d68c937b None None] REQUEST_METHOD: `POST` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:00.545423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748f8d0-1a82-4409-b9b0-8e75d68c937b None None] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:00.545423 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748f8d0-1a82-4409-b9b0-8e75d68c937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:00.626479 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.auth.core [None req-e748f8d0-1a82-4409-b9b0-8e75d68c937b None None] MFA Rules not processed for user `c231f9d11cce4493a85d6d5129afa3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 11 17:29:00.628328 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e748f8d0-1a82-4409-b9b0-8e75d68c937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:29:00.659717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1450/2851] 10.222.0.16 () {58 vars in 967 bytes} [Thu Nov 11 17:29:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 11 17:29:00.732487 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:00.766727 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c0678-79a3-402f-b1e5-5c7455a3b2e5 service neutron] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:00.774399 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a84fd-e146-4a4b-82f7-1e23d208f0e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc5d09e583e942e998f2c9808f1dc5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:00.775615 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a84fd-e146-4a4b-82f7-1e23d208f0e1 service swift] REQUEST_METHOD: `GET` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:00.776106 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a84fd-e146-4a4b-82f7-1e23d208f0e1 service swift] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:00.776558 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a84fd-e146-4a4b-82f7-1e23d208f0e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:00.789347 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a84fd-e146-4a4b-82f7-1e23d208f0e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:00.792455 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a84fd-e146-4a4b-82f7-1e23d208f0e1 service swift] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:00.809484 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1402/2852] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Nov 11 17:29:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 11 17:29:01.856562 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748f8d0-1a82-4409-b9b0-8e75d68c937b None None] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:01.858703 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e748f8d0-1a82-4409-b9b0-8e75d68c937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:29:01.875056 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748f8d0-1a82-4409-b9b0-8e75d68c937b None None] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:01.880049 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:01.880902 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:01.881182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:01.881458 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] PATH_INFO: `/v3/users/ee78fdb600b24b3eb455dea681814a38` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:01.882832 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee78fdb600b24b3eb455dea681814a38)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:01.884804 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:02.157293 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee78fdb600b24b3eb455dea681814a38'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.158409 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee78fdb600b24b3eb455dea681814a38'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.159510 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee78fdb600b24b3eb455dea681814a38'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.246057 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee78fdb600b24b3eb455dea681814a38'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.263182 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee78fdb600b24b3eb455dea681814a38'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.279515 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1451/2853] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:29:01 2021] DELETE /identity/v3/users/ee78fdb600b24b3eb455dea681814a38 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:29:02.587041 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a84fd-e146-4a4b-82f7-1e23d208f0e1 service swift] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:02.615639 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a84fd-e146-4a4b-82f7-1e23d208f0e1 service swift] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:02.691323 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:02.692183 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:02.692557 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:02.692971 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] PATH_INFO: `/v3/projects/53c4ca7574da4b2a868a39a52a98e620` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:02.694474 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c4ca7574da4b2a868a39a52a98e620)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:02.697200 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:02.853915 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c4ca7574da4b2a868a39a52a98e620', 'request_id': 'req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.921575 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c4ca7574da4b2a868a39a52a98e620', 'request_id': 'req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.932228 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c4ca7574da4b2a868a39a52a98e620', 'request_id': 'req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.953288 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] The token cache is being invalidate because project 53c4ca7574da4b2a868a39a52a98e620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:29:02.953689 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.954886 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:02.957266 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1403/2854] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:29:02 2021] DELETE /identity/v3/projects/53c4ca7574da4b2a868a39a52a98e620 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:29:02.962898 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:02.964572 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:29:02.981260 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7e0e-ec80-4a16-8a42-bcda11a42e92 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:03.072097 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:03.073777 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:03.074952 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:03.075724 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] PATH_INFO: `/v3/users/e33085db8f1043b1b4261e300ce80292` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:03.078054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33085db8f1043b1b4261e300ce80292)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:03.081962 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:03.322452 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33085db8f1043b1b4261e300ce80292'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:03.323289 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33085db8f1043b1b4261e300ce80292'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:03.323987 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33085db8f1043b1b4261e300ce80292'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:03.395086 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33085db8f1043b1b4261e300ce80292'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:03.411605 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33085db8f1043b1b4261e300ce80292'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:03.427717 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1452/2855] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:29:02 2021] DELETE /identity/v3/users/e33085db8f1043b1b4261e300ce80292 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 11 17:29:03.749110 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:03.751387 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:29:03.774044 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c3f5b-bd06-4953-9bbd-68868ed7edd3 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:03.854809 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:03.856935 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:03.857532 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:03.858103 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] PATH_INFO: `/v3/projects/8095b1a7a6bf4328a88245aa063676bf` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:03.860782 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8095b1a7a6bf4328a88245aa063676bf)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:03.865089 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:04.032955 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8095b1a7a6bf4328a88245aa063676bf', 'request_id': 'req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:04.126411 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8095b1a7a6bf4328a88245aa063676bf', 'request_id': 'req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:04.134047 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8095b1a7a6bf4328a88245aa063676bf', 'request_id': 'req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:04.147244 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] The token cache is being invalidate because project 8095b1a7a6bf4328a88245aa063676bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:29:04.147508 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:04.148240 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:04.149938 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1404/2856] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:29:03 2021] DELETE /identity/v3/projects/8095b1a7a6bf4328a88245aa063676bf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:29:11.456374 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:11.460891 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:29:11.476211 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645c80b-431c-4268-b833-05ba8e9d89c1 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:11.545936 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:11.547030 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:11.547421 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:11.547789 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] PATH_INFO: `/v3/users/a2a03a6f59274cd4aac3297e25ecd9be` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:11.549445 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a03a6f59274cd4aac3297e25ecd9be)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:11.551801 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:11.739897 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a03a6f59274cd4aac3297e25ecd9be'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:11.740991 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a03a6f59274cd4aac3297e25ecd9be'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:11.741992 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a03a6f59274cd4aac3297e25ecd9be'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:11.818999 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a03a6f59274cd4aac3297e25ecd9be'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:11.836253 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a03a6f59274cd4aac3297e25ecd9be'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:11.851220 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1453/2857] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:29:11 2021] DELETE /identity/v3/users/a2a03a6f59274cd4aac3297e25ecd9be => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:29:12.132512 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:12.134410 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:29:12.156737 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8266f6b-5e8f-4815-9884-bb92fa8eaca1 admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:12.223306 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:12.224007 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:12.224289 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:12.224561 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] PATH_INFO: `/v3/projects/0918d6b635a04c89ae9c7253d1a3901f` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:12.226023 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0918d6b635a04c89ae9c7253d1a3901f)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:12.228036 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:12.380805 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0918d6b635a04c89ae9c7253d1a3901f', 'request_id': 'req-61ccd4f7-2b3b-4321-b786-754081b5294c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:12.488223 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0918d6b635a04c89ae9c7253d1a3901f', 'request_id': 'req-61ccd4f7-2b3b-4321-b786-754081b5294c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:12.495457 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0918d6b635a04c89ae9c7253d1a3901f', 'request_id': 'req-61ccd4f7-2b3b-4321-b786-754081b5294c'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:12.508042 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] The token cache is being invalidate because project 0918d6b635a04c89ae9c7253d1a3901f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:29:12.508438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:12.509126 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:12.510772 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1405/2858] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:29:12 2021] DELETE /identity/v3/projects/0918d6b635a04c89ae9c7253d1a3901f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:29:12.516618 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:12.518713 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:29:12.539090 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b946b-85b9-4fed-ac9f-6675326a57d4 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:12.608386 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:12.609347 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:12.609669 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:12.609985 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] PATH_INFO: `/v3/users/e34d4005a5d64755ae431a3867c52e45` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:12.611619 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34d4005a5d64755ae431a3867c52e45)` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:12.613813 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:12.906630 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34d4005a5d64755ae431a3867c52e45'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:12.907323 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34d4005a5d64755ae431a3867c52e45'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:12.907952 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34d4005a5d64755ae431a3867c52e45'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:13.007623 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34d4005a5d64755ae431a3867c52e45'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:13.022032 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.notifications [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34d4005a5d64755ae431a3867c52e45'} {{(pid=79380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:13.035691 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1454/2859] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Nov 11 17:29:12 2021] DELETE /identity/v3/users/e34d4005a5d64755ae431a3867c52e45 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:29:13.405925 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] Authenticating user token {{(pid=79381) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:29:13.408316 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.fernet_utils [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79381) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:29:13.434590 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccd4f7-2b3b-4321-b786-754081b5294c admin admin] Validating token access rules against request {{(pid=79381) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:29:13.529548 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ae4cc8e79cb47cc8c55c2d79c2c09d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62f9c4d0b7f4443a8eb78e076640010', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79381) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:29:13.530438 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:29:13.530755 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:29:13.531037 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] PATH_INFO: `/v3/projects/3130da64ca90454cbfe95cf315e224fb` {{(pid=79381) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:29:13.532358 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3130da64ca90454cbfe95cf315e224fb)` {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:29:13.534304 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] RBAC: Authorization granted {{(pid=79381) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:29:13.679132 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3130da64ca90454cbfe95cf315e224fb', 'request_id': 'req-d410d0ba-4719-4ece-886b-5dc8072c9876'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:13.762930 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3130da64ca90454cbfe95cf315e224fb', 'request_id': 'req-d410d0ba-4719-4ece-886b-5dc8072c9876'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:13.772882 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3130da64ca90454cbfe95cf315e224fb', 'request_id': 'req-d410d0ba-4719-4ece-886b-5dc8072c9876'} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:13.793214 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] The token cache is being invalidate because project 3130da64ca90454cbfe95cf315e224fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79381) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 11 17:29:13.793720 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:13.795370 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: DEBUG keystone.notifications [None req-d410d0ba-4719-4ece-886b-5dc8072c9876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79381) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 11 17:29:13.798111 dv-cinder-694140-2-iscsi devstack@keystone.service[79381]: [pid: 79381|app: 0|req: 1406/2860] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Nov 11 17:29:13 2021] DELETE /identity/v3/projects/3130da64ca90454cbfe95cf315e224fb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 11 17:33:28.143785 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] Authenticating user token {{(pid=79380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 11 17:33:28.145538 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:33:28.222054 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438df61-0947-48e3-b6af-3dc6f436b064 admin admin] Validating token access rules against request {{(pid=79380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 11 17:33:28.283685 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b2019-b333-44bd-b018-b0163eab378e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db055fddc41c4eb0ba1c3b410e1e8e03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab3f75658c74a4abb8afd770e2087f5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 11 17:33:28.284339 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2019-b333-44bd-b018-b0163eab378e service placement] REQUEST_METHOD: `GET` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 11 17:33:28.284616 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2019-b333-44bd-b018-b0163eab378e service placement] SCRIPT_NAME: `/identity` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 11 17:33:28.284885 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2019-b333-44bd-b018-b0163eab378e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 11 17:33:28.286704 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.fernet_utils [None req-9c2b2019-b333-44bd-b018-b0163eab378e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 11 17:33:28.298191 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b2019-b333-44bd-b018-b0163eab378e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 11 17:33:28.299799 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b2019-b333-44bd-b018-b0163eab378e service placement] RBAC: Authorization granted {{(pid=79380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 11 17:33:28.309852 dv-cinder-694140-2-iscsi devstack@keystone.service[79380]: [pid: 79380|app: 0|req: 1455/2861] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Nov 11 17:33:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)